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DECISION-THEORETIC  AND  EMPIRICAL  INVESTIGATION  OF 
SOME  PROBABILISTIC  DISCRIMINATION  LEARNING  SITUATIONS 

ABSTRACT 

A  decision-theoretic  analysis  and  experiment  of  three  related  choice 
situations  is  presented.  The  first  situation  is  a  standard  probabilistic 
discrimination  learning  task.  Each  trial  begins  with  the  presentation  of 
one  of  a  set  of  stimuli.  The  subject  must  choose  between  two  response 
alternatives  to  predict  which  of  two  events  will  occur  on  the  trial,  the 
probability  of  each  event  being  a  function  of  the  stimulus  presented.  The 
second  situation  arises  when  the  conditional  probabilities,  i.e.  ,  the 
probabilities  of  the  stimuli  given  the  events,  are  introduced  to  the  subject 
at  the  beginning  of  the  experiment.  The  third  situation  is  like  the  second 
except  for  the  fact  that  the  subject  is  not  told  which  event  occurs  on  each  trial. 

The  decision-theoretic  analysis  shows  what  differences  in  performance 
would  be  expected  among  the  three  conditions  when  a  strategy  which  maximizes 
average  expected  payoff  is  employed. 

One  group  of  subjects  was  run  in  each  situation  with  the  overall  relative 
frequency  of  one  event  equal  to  .  80.  The  performance  of  the  subjects  in 
the  first  and  second  situations  was  virtually  identical,  while  the  performance 
of  the  subjects  in  the  third  (non-feedback)  was  somewhat  worse.  The 
performance  measure  was  the  sum  of  the  differences  between  the  objective 
expected  payoff  of  the  optimal  choices  and  the  choices  made  by  the  subject. 
Comparisons  of  the  choice  proportions  for  the  first  and  second  groups 
indicated  that  subjects  in  the  second  group  did  not  integrate  information 
concerning  the  overall  relative  frequencies  of  events  and  conditional 
probabilities.  A  large  proportion  of  subjects  in  the  third  (non-feedback) 
group  made  every  choice  in  agreement  with  the  assumption  that  the  overall 
relative  frequency  of  one  event  was  one -half. 
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CHAPTER  I 
INTRODUCTION 

During  the  past  ten  years  there  has  been  an  increasing 
research  interest  in  decision  behavior  in  binary  choice  sit¬ 
uations.  Most  of  the  experimental  studies  have  been  restric¬ 
ted  to  cases  in  which  the  same  stimulus  is  presented  on  each 
trial.  However,  there  have  been  a  few  studies  in  which  the 
same  stimulus  is  not  presented  on  each  trial.  Burke  and 
Estes  (1957)  proposed  a  model  for  the  latter  type  of  situa¬ 
tion  which  has  been  called  probabilistic  discrimination  learn¬ 
ing.  Since  1957  there  have  been  very  few  studies  relating  to 
probabilistic  discrimination  learning,  and,  in  general  the 
results  of  such  experiments  have  not  been  in  agreement  with 
the  Burke-Estes  model.  (See,  for  example,  Atkinson,  Bogartz, 
and  Turner,  1959;  Shaffer,  1962.) 

More  reacntly,  interest  has  developed  in  Bayesian  models 
of  decision  making.  Shuford  and  Hall  (1959)  presented  a 
3ayesian  interpretation  of  psychophysical  judgemnts  and  sug¬ 
gested  an  asymptotic  response  model  for  judgment  behavior 
in  a  percentage  estimation  task.  Later,  Uiesen  and  Shuford 
(1962)  tested  this  model  in  an  experiment  in  which  Ss  were 
shown  the  central  nine  elements  of  16x16  matrices  composed 
of  randomly  placed  l’s  and  0's.  The  task  was  to  estimate  the 
proportion  of  l's  in  the  large  l6xl6  matrices  from  observing 
the  samples  of  size  nine.  In  this  case  S  was  permitted  to 
use  any  of  the  101  response  alternatives  05,  1J 2,  .  .  .,  1005. 
If  this  task  is  changed  so  that  S  is  only  permitted  to  use 


two  response  alternatives,  say,  Aq  and  A^,  tne  decision 
task  is  formally  identical  to  the  probabilistic  discrimi¬ 
nation  learning  task. 

The  relation  between  the  two  tasks  prompts  appropriate 
consideration  of  the  possible  role  of  a  Bayesian  model  of 
decision  making  in  a  learning  task.  Tnis  role  will  be  clari¬ 
fied  in  a  moment,  but  it  is  first  necessary  to  give  a  more 
explicit  statement  of  the  type  of  task  under  consideration. 

Each  trial  of  an  experiment  is  initiated  by  the  onset 
of  an  unambiguous  stimulus  such  as  a  colored  lirht  (Shaffer, 
1962).  The  trial  is  terminated  when,  after  S  has  made  his 
choice,  the  experimenter  announces  the  choice  which  is  cor¬ 
rect  for  the  trial.  Let  S  denote  the  exhaustive  set  of  mu¬ 
tually  exclusive  stimuli,  S  =  {s^jSg,  .  .  .,  sn} .  Let  EQ 


and  E^  denote  the  two  possible  events  and  let  Aq  and  A^  de¬ 
note  the  two  responses  available  to  5.  Further  let  P^E.'Is^) 
denote  the  proportion  to  times  that  event  E  has  been  called 

J  +•  H 

correct  for  stimulus  s^.  up  to,  but  not  including  the  k 
trial. 


The  stimulus  to  be  presented  on  a  given  trial  is  chosen 
by  the  following  scheme.  Let  nQ  be  the  probability  that 
event  EQ  occurs  on  a  given  trial.  A  Bernoulli  process  is 
used  to  generate  a  sequence  of  events  of  type  EQ  and  E^. 
Further  let  P,(si|Ej)  denote  the  probability  that  stimulus 
s^  will  occur  on  a  particular  trial  given  tnat  E^  is  the 
event  for  that  trial.  A  random  process  is  used  to  generate 
the  stimuli  in  conformity  with  the  probability  measure 
P'(SjJEj)  *  j •  (Investigators  may  not  always  use  this 
scheme  to  generate  the  stimulus-response  assignments.  Rather, 
that  is  one  way  to  do  it,  and  conceptualizing  the  process  in 
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this  way  leads  to  a  clear  picture  of  the  structure  of 
the  experimental  task  as  objectively  defined. ) 

It  will  be  recalled  that  Bayes  theorem  nay  be 
written  P(3]L|A)  =  PCB^) P( A 1 31)/  z  P CBA ) P( A | B± ) 

if  B2,  .  .  . ,  Bn  are  mutually  exclusive,  and  if  AcB^oSgU 

.  .  .OB  .  From  this  it  follows  that 
n 

(l)  P 1 (eq | s± )  =  n0P»(s1|E0)/[n0P'(si|E0)  +  (l  -  n0)P*(si|E1)] 

where  P'(Eq|s^)  is  the  objective  posterior  probability  of 
event  EQ  given  stimulus  s^.  A  similar  expression  can  be 
written  for  P’(E^js^K 

On  each  trial,  then,  S  is  presented  with  an  unambiguous 
stimulus  and  is  to  guess  or  decide  which  event  will  follow. 

As  the  trials  proceed  S  is  able  to  obtain  a  more  accurate 
estimate  of  the  posterior  probabilities,  P’(Ej|s^)  since 
S  is  told  which  event  occurred  on  each  trial  after  he  has 
made  his  choice.  At  the  moment  that  S  makes  a  choice,  he 
will  never  be  certain  that  his  choice  is  correct,  but  he 
can  maximize  the  expected  number  of  correct  choices  for 
each  stimulus  by  choosing  that  alternative  which  has  more 

O- 

often  been  associated  with  the  stimulus  in  the  past. 

The  task  described  above  can  clearly  be  interpreted  as 
one  of  decision  making  under  uncertainty.  On  each  trial  S 
is  to  make  a  decision  about  the  state  of  the  world  (it  is 
either  Eq  or  E^  in  the  light  of  certain  information  rela¬ 
ting  to  that  state  (this  stimulus  has  been  associated  with 
Eq  more  often  in  the  past  than  with  E^.  There  are  certain 
advantages  to  be  expected  from  viewing  this  task  within  a 
decision-theoretic  frame  of  reference.  For  one  thin'*,  it 
will  clearly  show  how  choice  behavior  directed  toward 
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achieving  maximum  expected  payoff  is  effected  by  certain  struc¬ 
tural  changes  to  be  introduced.  The  result  of  the  decision- 
theoretic  analysis  will  provide  a  reference  ooint  which  will 
help  in  interpreting  the  choice  behavior  of  subjects  oerforming 
the  task.  It  should  not  be  used  to  convince  or  dissuade  one 
that  individuals  are  "rational"  or  "irrational,"  rather  it 
should  be  viewed  as  an  aid  in  understanding  choice  behavior. 

The  discussion  section  of  this  dissertation  will  be  evidence 
of  the  heuristic  value  of  a  decision-theoretic  approach. 

In  order  that  the  relation  between  learning  and  decision 
making  be  clarified,  it  will  be  helpful  to  distinguisn  two 
levels  of  organization  which  lead  to  changes  in  resoonse  be¬ 
havior  as  a  function  of  trials.  The  first  level  of  organi¬ 
zation  is  concerned  with  the  utilization  of  a  particular 
decision  rule.  For  instance,  consider  the  decision  rule  which 
maximizes  the  number  of  correct  choices  over  the  trials  of 
the  experiment. 


(2) 


Choose  Aq  for  s^  whenever  6^  >1/2. 
Choose  for  s^  whenever  6 <1/2 . 


Choose  Aq  with  probability  1/2  and  A.^  with 
probability  1/2  for  si  whenever  <$^  =  1/2, 
where  6^  =  P^CEqJs^).  In  order  that  this  rule  be  apolicable 
throughout  an  experiment,  it  is  necessary  to  define  5^.  One 
way  to  do  this  is  to  assume  that  6^  is  the  mean  of  an  uncer¬ 
tainty  distribution  of  P’(Eq|s^),  and  that  this  distribution 
can  be  represented  by  a  beta  distribution  with  parameters 
(r'  =  1,  n'  =2).  The  mean  of  this  distribution  is  6 
After  the  k^h  trial 

(3)  6 


'il 


r' 

nT 


*ik 


r*  +  (Number  of  times  si  has  been  followed  by  En) 

n*  +  (lJumber  of  times  s^  has  occurred) 


(See  Appendix  I  for  a  more  detailed  explanation  of  this 
decision  rule.) 

As  mentioned  before  this  decision  rule  will  maximize 
the  number  of  correct  choices  over  the  trials  of  the  ex¬ 
periment.  The  stimuli  represent  the  inputs  to  the  decision 
rule,  and  the  responses  represent  the  outputs.  Because 
of  the  nature  of  the  task,  the  output  for  a  particular  in¬ 
put  will  change  as  a  function  of  trials.  (Note  that  this 
is  not  necessarily  the  case,  but  will  be  true  as  P^(Eq|s^) 
fluctuates  about  one-half. )  The  processes  which  lead  to 
response  changes  relative  to  a  specific  decision  rule  are 
ones  of  assimilation  and  utilization  of  information.  To  the 
extent  that  different  individuals  use  different  decision 
rules,  the  use  of  response  proportions  obtained  from  groups 
of  subjects  and  averaged  over  trials  will  yield  little  in¬ 
formation  concerning  these  processes. 

Assume  that  a  person  uses  the  decision  rule  in  expres¬ 
sion  (2)  in  this  situation.  Are  there  instances  in  which 
his  responses  would  not  be  predicted  by  the  output  of  the 
decision  rule?  Obviously,  the  first  time  a  stimulus  occurs, 
and  whenever  else  P^(Eq|s^)  is  equal  to  one-half,  the  de¬ 
cision  rule  does  not  specify  a  unique  response.  But  be¬ 
sides  these  cases,  perfect  use  of  the  decision  rule  requires 
that  there  be  errorless  identification  of  the  stimuli  and 
correct  choices,  and  that  memory  be  perfect.  Assuming  that 
sufficient  allowances  are  made  by  the  exoerimenter  to  eli¬ 
minate  errors  due  to  memory  or  misidentification,  the  output 
of  the  decision  rule  will  predict  S's  responses  in  all  cases 
except  where  P^EqIs.^)  is  equal  bo  one-half.  If  the  decision 
rule  used  by  S  is  not  known  to  the  experimenter,  response 
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changes  are  liable  to  be  attributed  to  some  other  process. 

The  other  level  of  organization  to  be  distinguished 
here  is  that  which  relates  to  changes  of  the  decision  rule 
in  an  experiment.  The  experimenter  knows  how  the  stimulus- 
event  assignments  came  about,  and  is,  therefore,  able  to 
specify  the  decision  rule  which  will  be  best  for  achieving 
some  performance  criterion.  If,  for  instance,  the  experimen¬ 
ter  knows  that  a  regular  sequence  is  being  used  such  as 
"stimulus  s^  is  followed  by  Eq  three  times,  by  twice,  by 
EQ  three  times,  by  E^  twice,  etc.,"  the  decision  rule  given 
in  (2)  would  not  be  the  best  for  achieving  the  maximum  ex¬ 
pected  number  of  correct  choices.  It  is  only  in  terms  of 
the  experimental  structure  specified  earlier  that  the  deci¬ 
sion  rule  given  in  (2)  is  best.  The  individual  performing 
the  task  is  very  likely  not  to  perceive  the  situation  as  it 
actually  is  structured.  Even  if  the  experimenter  goes  to 
some  length  to  explain  the  structure  to  S,  there  may  be  some 
lack  of  understanding  or  some  feeling  that  there  is  a  solu¬ 
tion  which  will  improve  performance.  This  is  not  an  attempt 
to  explain  deviations  from  the  optimal  rule  in  terms  of  mis¬ 
trust  or  stupidity  on  the  part  of  S,  but  it  must  be  accepted 
that  the  experimenter  has  less  than  complete  control  over  S*s 
perception  of  the  task. 

The  effect  of  this  difference  in  perception  is  that  S 
may  adopt  different  decision  rules  at  different  stages  in  the 
experiment,  or  he  may  adopt  one  decision  rule,  but  this  rule 
may  not  be  the  best  rule  for  achieving  the  goals  set  by  the 
experimenter,  considering  the  structure  of  the  task  as  known 
by  the  experimenter.  Again,  use  of  response  oroportions  ob¬ 
tained  from  trial  by  subject  averaging  would  seem  to  yield 
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little  information  concerning  what  decision  rules  are  adop¬ 
ted  by  the  individuals  Who  comprise  a  group,  and  would  defy 
analysis  of  the  effect  which  experience  with  a  particular 
task  may  have  upon  the  change  of  decision  rule. 

There  are  those  who  would  argue  that  this  method  of 
attacking  the  problem  has  little  merit  (see  Estes,  1962). 

Yet  it  would  seem  instructive  to  see  what  kinds  of  questions 
arise  once  this  approach  has  been  adopted.  One  area  of  in¬ 
terest  is  concerned  with  identifying  the  decision  rules  which 
are  adopted  by  S  in  this  type  of'  situation.  Toda  (1962) 
has  conducted  several  experiments  to  investigate  the  kinds 
of  decision  rules  which  are  adopted  by  subjects  in  a  pro¬ 
bability  learning  task.  One  of  his  most  interesting  find¬ 
ings  is  that  the  proportion  of  deterministic  hypotheses  is 
greater  than  the  proportion  of  stochastic  hypotheses  during 
the  early,  trials  of  the  experiments.  In  one  experiment  con¬ 
sisting  of  100  trials,  the  proportion  of  stochastic  hypo¬ 
theses  became  greater  than  the  proportion  of  deterministic 
hypotheses  only  after  40  trials.  In  this  case,  no  advance 
information  was  given  concerning  the  nature  of  the  event 
sequence.  (Those  who  are  doubtful  about  the  relationship 
between  rules  stated  by  subjects  and  the  resultant  behavior 
are  referred  to  a  very  interesting  account  of  the  interpre¬ 
tation  of  rule  statement  given  by  Verplanclc,  1962.  Although 
the  task  in  Verplanck's  experiment  was  a  concept  identifi¬ 
cation  task,  he  makes  a  penetrating  analysis  of  the  relation 
between  rule  statement  and  choice  behavior.  Similar  evidence 
for  correspondence  between  verbal  rule  statement  and  sub¬ 
ject's  performance  on  a  task  is  to  be  found  in  the  recent 
dissertation  of  Johnson,  1961.) 
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Another  type  of  question  arising  from  this  approach 
relates  to  the  structure  of  the  task  as  presented  to  S.  As 
mentioned  before,  the  soecification  or  adoption  of  a  decision 
rule  depends  upon  understanding  the  structure  of  the  task  as 
well  as  the  performance  criterion  which  is  adopted.  Experi¬ 
ments  have  been  conducted  in  probability  learning  situations 
in  which  the  instructions  given  to  3  at  the  beginning  of  the 
experiment  have  been  varied  in  one  manner  or  another.  Por 
instance,  Nies  (1962)  gave  one  group  of  Ss  the  usual  probabil 
ity  learning  instructions.  Another  group  was  told  that  the 
events  tended  to  occur  in  definite  patterns.  A  third  and 
fourth  group  ifere  told  the  ratio  of  Eq  to  E^,  with  the  fourth 
group  receiving  additional  information  that  there  could  be  no 
fixed  pattern.  (Eq  occurs  more  frequently  than  in  all  ' 
cases.)  In  all  these  cases  the  events  consisted  of  outcomes 
when  drawing  marbles  from  a  box  with  replacement.  A  control 
group  was  added  with  the  usual  probability  learning  instruc¬ 
tions,  but  the  box  was  missing.  (The  intended  effect  of  the 
box  for  groups  1-4  was  to  suggest  randomness.)  The  finding 
was  that  the  information  supplied  to  Ss  led  to  differences 
in  performance  during  the  first  150  trials.  The  grouos  who 
were  told  the  ratio  of  EQ  to  gave  more  AQ  responses  during 
these  early  trials.  Furthermore,  while  the  control  c-roun  pro 
bability  matched,  that  is,  the  asymptotic  probability  of  AQ 
approached  iIq,  during  trials  201-250,  the  other  groups  gave 
significantly  more  EQ  guesses.  This  study,  and  others  (for 
instance,  McCracken,  Osterhout  and  Voss,  1962)  are  related  to 
the  structure  of  the  task  as  presented  to  S.  The  major  defi¬ 
ciency  is  that  there  is  no  way  to  state  exactly  what  changes 
in  behavior  are  to  be  expected  as  a  result  of  varying  the 
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instructions  given  to  S.  However,  there  are  other  ways  to 
manipulate  the  structure  of  the  task  as  presented  to  S  which 
lead  to  an  exact  formulation  of  the  differences  which  are  in¬ 
duced  in  the  logical  structure  of  the  task.  Knowing  what 
effect  a  change  in  structure  should  have  in  terms  of  the 
logical  properties  of  the  task  will  afford  a  baseline  with 
which  to  compare  the  performance  of  Ss  in  the  experiment. 
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CHAPTER  II 


DESIGN  OF  EXPERIMENT 


One  purpose  of  this  dissertation  is  to  present  a  decision- 
theoretic  analysis  of  certain  choice  situations  which  arise 
when  certain  aspects  of  the  probabilistic  discrimination  learn¬ 
ing  situation  are  changed.  One  aspect  to  be  considered  is 
the  relationship  among  the  stimuli  in  tnese  choice  situations> 
while  the  other  aspect  is  the  information  concerning  which 
event  occurred  on  each  trial.  These  changes  affect  the  logi¬ 
cal  structure  of  the  situation  and,  presumably,  the  perceived 
structure.  The  other  puroose  of  this  dissertation  is  to  in¬ 
vestigate  and  interpret  the  choice  behavior  of  subjects  in  the 
different  situations. 

Before  the  exact  nature  of  the  proposed  changes  is  pre¬ 
sented,  it  is  necessary  to  set  the  boundary  conditions.  The 
performance  criterion  to  be  used  is  that  of  maximizing  ex¬ 
pected  payoff.  In  order  to  simplify  the  discussion,  a  oayoff 
matrix  whi  ;h  can  be  reduced  to  the  following  form  will  be 


used: 

E0 

£1 

Ao 

u 

0 

A1 

0 

u 

In  this  matrix  Eg  and  E^  are  the  two  possible  events,  AQ  and 
A^  are  the  response  alternatives,  and  each  entry  in  the  matrix 
is  the  payoff  realized  if  response  Aj  is  chosen  and  event  occui 
(See  Appendix  I  for  a  discussion  of  matrices  which,  for  the 
purposes  here,  can  be  reduced  to  this  form.) 


The  purpose,  then,  of  what  follows  is  to  show  the  effect 
that  certain  structural  changes  will  have  on  the  choices  of 
a  person  who  behaves  so  as  to  maximize  expected  payoff.*  This 
person  must  be  capable  of  correctly  identifying  the  stimuli 
and  of  recognizing  correct  responses  after  being  given  iden¬ 
tification  of  the  occuring  event.  He  must  also  be  able  to 
remember  certain  things  about  the  sequence  of  events. 

Three  different  experimental  settings  will  be  discussed. 
The  first  is  identical  to  the  Drobabilistic  discrimination 
learning  situation  discussed  earlier.  The  second  is  similar 
to  this  with  one  major  exception — that  the  conditional  probabi¬ 
lities,  the  P'(s^IEj),  are  given  at  the  beginning  of  the  exper¬ 
iment.-  The  third  setting  resembles  the  second  in  that  the 
conditional  probabilities  are  given,  but  differs  in  that  in  the 
second  setting  S  is  told  which  event  occurred  after  he  has 
made  his  choice,  while  in  the  third  setting  S  is  not  given  this 
information.  These  settings  will  be  discussed  one  at  a  time, 
and  the  manner  in  which  the  output  of  the  decision  rule  changes 
as  a  function  of  trials  will  be  shown. 

Task  CC. — In  this  case  S  is  given  the  correct  choices  on 
each  trial,  but  there  is  no  a  priori  relationship  among 
the  stimuli.  The  decision  rule  which  maximizes  expected  pay¬ 
off  is  given  in  expression  (2).  Use  of  this  decision  rule 
requires  that  the  quantity  Pj^EqIs.^)  be  remembered  for  each 
stimulus.  As  the  number  of  stimuli  increases,  so  does  the 
number  of  different  quantities  which  must  be  remembered. 

Before  a  particular  stimulus  has  occurred,  there  is  no  log¬ 
ically  compelling  reason  to  favor  one  response  over  the  other. 

*The  term  optimal  choice  will  be  used  to  denote  that 
choice  which  has  the  higher  objective  expected  payoff  given 
that  all  conditions  and  parameters  relevant  to  the  choice  are 
knov:n. 
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For  instance,  assume  that  stimulus  occurs  for  the  first 
time  on  trial  20,  that  the  correct  choice  for  all  previous 
trials  has  been  EQ,  and  that  several  other  stimuli  have  oc¬ 
curred.  One  assumption  which  would  lead  to  favoring  on 
trial  20  is  that  there  must  be  some  stimulus  which  is  an 
indicator  of  E^.  Since,  to  this  point,  other  stimuli  have 
indicated  EQ,  it  is  more  likely  that  is  correct  for  si, 

the  stimulus  presented  on  trial  20.  On  the  other  hand,  one 
might  assume  that  since  all  of  the  stimuli  up  to  trial  20 
have  been  associated  with  Eq,  it  is  more  likely  that  the  sti¬ 
mulus  presented  on  Trial  20  also  indicated  Eq.  Neither  ar¬ 
gument  can  be  defended  without  adding  assumptions  other 
than  those  known  to  be  true  from  the  way  in  which  the  task 
is  presented.  However,  setting  6^equal  to  one-half  requires 
no  extra  assumptions. 

Task  CP-CC. — For  the  task  described  above,  then,  there 
is  no  a  priori  relation  among  the  members  of  the  stimulus  set. 
However,  if  the  conditional  probabilities  are  given  at  the 
beginning  of  the  experiment,  there  is  a  definite  relation  a- 
mong  the  stimuli. 

As  shown  in  Appendix  I,  the  decision  rule  which  maximizes 
expected  payoff  for  this  condition  is  very  similar  to  the  de¬ 
cision  rule  presented  in  expression  (2)  for  the  CC  condition. 
The  decision  rule  is 

(3)  Choose  Aq  for  s±  whenever  P^( EQ | si )  >1/2. 

Choose  A^  otherwise. 

In  expression  (3)  (Eq|s^)  is  the  posterior  probability  of 

Eq  given  stimulus  s±,  The  posterior  probability  is  a  function 
of  the  conditional  probabilities  relevant  to  the  stimulus  s1, 
the  sequence  of  events  up  to,  but  not  including,  the  trial. 
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and  an  initial  prior  distribution.  The  role  of  the  latter 
distribution  will  be  clarified  in  a  moment.  Decomposition 
of  the  terms  in  expression  (3)  into  prior  and  conditional 
probabilities  leads  to  some  interesting  facts*.  Consider* 
for  instance,  (Egls.^), 

(4)  p  i  (E0|s1)  =  P’(si|E0)n£/[p»(s1|E0)n4,  +  p«  (sjE^U-n^)] , 

Every  quantity  in  this  equation  is  familiar  with  the 
exception  of  n^.  if  the  proportion  of  Eg  events  is  known. 

=  nQ.  When  the  proportion  of  Eg  events  is  not  known, 
is  the  mean  of  a  distribution.  This  distribution  reflects 
the  uncertainty  about  the  proportion  of  Eg  events.  Assume 
that  at  the  beginning  of  an  experiment  S  feels  that  the 
proportion  of  Eg  events  is  equal  to  the  proportion  of 
events,  but  it  would  take  very  little  information  for  him 
to  be  convinced  otherwise.  That  is,  S  is  uncertain  about 
the  true  proportion  of  Eg  events,  and  he  places  little 
faith  in  any  one  number.  This  subjective  distribution  can 
be  approximated  by  a  beta  distribution  with  parameters 
(a  =  l,  8=1),  the  uniform  distribution  of  the  interval 
(0,1).  This  distribution  is  changed  as  a  function  of  trials, 
and  it  is  the  mean  of  this  distribution  which  is  relevant 
in  making  decisions.  Decision  rule  (3)  can  be  re-written 

(5)  Choose  Ag  whenever  P^(Cg|si)/  P^E^Js^)  >1. 

Choose  A.^  otherwise. 

Substituting  the  term  on  the  right  side  of  (1)  for  the 
terms  on  the  left  side  of  (5)  and  rearranging  terms,  (3) 
becomes 

P’(s±K) 

(6)  Choose  A0  whenever  >  p.  (s±  |i-0)+p<  UjjISp  ‘ 

Choose  A^  otherwise. 
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The  right  side  of  (6)  is  fixed  by  the  initial  conditions  of  the 
experiment.  It  is  the  value  of  which  determines  the  choice 
on  each  trial.  The  distribution  of  is  given  in  Appendix  I. 

A  proof  that  converges  to  IIq  is  also  given. 

The  essential  aspects  are  that  the  distribution  of 
depends  only  upon  the  number  of  times  that  En  has  occurred 
up  to  the  2.  trial.  There  is  only  one  quantity  which  needs 
to  be  remembered,  and  the  information  about  the  correct 
choices  for  all  stimuli  is  logically  relevant  to  the  choice 
to  be  made  for  any  one  stimulus.  In  general,  performance, 
as  determined  by  reference  to  the  optimal  choices,  is  better 
when  the  conditional  probabilities  are  given  than  when  these 
probabilities  are  not  given.  The  optimal  choice  is  the  choice 
which  has  the  higher  objective  expected  payoff. 

Task  CP-CC.— The  third  experimental  setting  is  similar 
to  the  second  with  the  exception  that  the  correct  choices  are 
not  given  on  each  trial.  In  this  case  the  decision  rule 
given  in  equation  (6)  is  also  applicable.  The  difference  in 
this  situation  is  the  distribution  of  n  .  In  this  case,  the 
distribution  depends  upon  the  ratio  P’  (s.jJEqJ/P'  (s^jE  ) . 

The  result  that  the  decision  rule  is  the  same  for  the  CP-CC 
condition  and  the  CP-CC-  condition  and  that  the  only  dif¬ 
ference  between  these  two  conditions  is  the  distribution  of 
n  is  rather  surprising.  The  essential  aspect  here  is  that 
with  the  CP-CC  condition  the  result  of  each  trial  is  the 
exact  knowledge  of  which  event  occurred,  while  with  the 
CP-CC-  condition  each  trial  terminates  with  information  con¬ 
cerning  the  likelihood  that  the  stimulus  for  that  trial  was 
produced  by  either  of  the  events.  This  is  to  some  extent 
similar  to  making  inferences  about  a  parameter  on  the  basis 
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of  an  infinite  sample  (CP-CC)  as  opposed  to  a  small  sample 
(CP-CC).  The  reader  is  again  referred  to  Appendix  I  for  the 
details.  In  this  case,  n&  does  not  converge  to  as  rapidly 
as  when  the  correct  choices  are  given.  Performance  in  this 
case  should  be  worse  than  in  the  other  two  cases. 

The  experiment  to  be  reported  here  was  designed  to  com¬ 
pare  the  performance  of  Ss  in  these  three  conditions.  The 
first  purpose  is  to  see  how  far  the  performance  of  Ss  in 
each  setting  diverges  from  the  respective  optimal  performance 
The  second  purpose  is  to  see  how  performance  of  Ss  in  each 
group  compares  with  performance  of  Ss  in  the  other  groups. 

It  is  not  to  be  expected  that  actual  performance  matches 
the  performance  of  the  optimal  models.  The  optimal  models 
entertain  no  false  hypotheses  about  the  structure  of  the  sit¬ 
uation,  have  perfect  memory,  and  compute  solutions  from  analy 
tic  equations.  The  optimal  models  use  an  unambiguous  and 
inalterable  performance  criterion.  On  the  other  hand,  humans 
do  not  have  perfect  memory,  may  adopt  one  of  an  infinite  va¬ 
riety  of  performance  criteria,  and  are  quite  likely  to  enter¬ 
tain  false  pattern  hypotheses. 

The  main  value  of  the  optimal  models  is  that  they  show 
exactly  what  differences  are  induced  in  choice  behavior  by 
the  changes  which  are  made.  They  afford  a  standard  against 
which  the  performance  of  Ss  can  be  compared,  and  hence  give 
more  meaning  to  differences  in  performance  by  Ss  in  the 
different  settings. 

It  is  expected  that  some  Ss  in  the  condition  where  the 
conditional  probabilities  are  not  given,  but  the  correct 
choices  are  given  (CC)  will  adopt  a  decision  rule  similar  to, 
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if  not  identical  to,  that  presented  in  (2).  The  performance 
of  this  group  should  be  somewhat  nearer  the  optimal  perfor¬ 
mance  than  a  probability  matching  performance.  This  resuit 
would  be  consistent  with  the  findings  by  Estes,  3urke ,• Atkin¬ 
son  and  Frankmann  (1957). 

Where  the  performance  of  the  3s  who  receive  both  condi¬ 
tional  probabilities  and  correct  choices  (CP-CC)  will  stand 
relative  to  the  model  performance  and  relative  to  the  perfor¬ 
mance  of  the  (CC)  group  is  an  open  question.  Shuford  and 
Wiesen  (1959)  have  offered  evidence  for  a  Bayesian  interpre¬ 
tation  of  proportion  estimates  in  the  experiment  mentioned 
earlier.  In  this  case  it  is  difficult  to  tell  whether  the  Ss 
are  learning  the  posterior  probabilities,  or  whether  there 
is  some  perceptual  reorganization  related  to  the  distribution 
of  stimuli  being  used.  Ward  Edwards  (personal  communication) 
has  conducted  some  experiments  in  which  the  task  was  to  esti¬ 
mate  posterior  probabilities  from  information  about  the  con¬ 
ditional  probabilities  and  the  prior  probabilities.  The  Ss 
performing  this  task  do  not  make  very  accurate  use  of  the 
information  and  their  estimates  are  not  very  well  related  to 
the  objective  posterior  probabilities.  The  experimental 
task  to  be  used  here  is  somewhere  between  these  two  tasks. 

It  differs  from  the  Edwards  experiment  in  that  the  task  is 
to  make  a  choice  and  not  an  estimate.  However,  in  order  to 
make  his  choice  in  agreement  with  the  optimal  model,  S  must 
be  able  to  integrate  information  about  the  prior  probability 
with  information  about  the  conditional  probabilities.  This 
is  what  the  Ss  in  Edwards’  experiment  were  not  able  to  do 
very  we 11  at  the  level  of  stating  estimates  of  the  posterior 
probabilities . 
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Jehaviorally ,  then,  the  task  under  consideration  here 
is  more  similar  to  the  task  presented  by  Shuford  and  \riesen 
in  that  S  must  make  a  decision  ratner  than  an  estimate  of  a 
posterior  probability.  However,  the  point  of  focus  in  the 
Shuford-’/eisen  experiment  was  the  asymptotic  responses  of 
the  Ss.  As  mentioned  before,  there  is  a  possibility  that 
the  posterior  probabilities  were  being;  learned.  However, 
in  the  task  under  cnnsideratlon  here,  the  ooint  of  focus 
is  the  trial  by  trial  changes  in  choice  behavior.  It  should 
be  rather  easy  to  discriminate  learning  of  posterior  pro¬ 
babilities  from  a  process  which  combines  the  information 
about  the  prior  probabilities  and  the  information  about  the 
conditional  probabilities.  It  will  not  be  surprising  if  ti'.f 
performance  of  Ss  in  the  .(CP-CC)  condition  is  rather  similar 
to  the  performance  of  those  in  the  (CC)  condition. 

The  performance  of  Ss  in  the  condition  where  the  con¬ 
ditional  probabilities  are  given,  but  no  correct  choices 
are  given  (CP-CU")  should  not  be  as  good  as  the  performance 
of  the  other  groups.  However,  the  difference  between  the 
Ss'  performance  and  the  performance  of  the  model  might  be 
greater  in  this  condition  than  in  the  others.  Wiesen  and 
Shuford  (1962)  used  this  condition  in  the  matrix  experiment 
discussed  earlier,  and  found,  essentially,  no  change  in 
performance  as  a  function  of  trials,  most  Ss  tended  to  re¬ 
spond  with  estimates  near  the  proportion  given  in  tne  sample 
matrix.  In  the  case  of  the  experiment  being  performed  here, 
the  main  difference  between  the  two  groups  (CP-CC)  and 
(CP-CC)  is  the  information  given  to  the  Ss  concerning  the 
proportion  of  Eq  events.  The  Ss  in  tne  latter  group  must 
get  this  information  from  the  stimuli  which  occur,  while 
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the  3s  in  the  (CP-CC)  group  are  told  v/hich  event  occurs  on 
each  trial.  However,  the  extent  to  which  3s  are  incaoable 
of  using  this  information  should  increase  the  difference  be¬ 
tween  these  two  groups.  The  Ss  given  the  correct  choices  can 
learn  the  posterior  probabilities,  while  Ss  who  are  not  given 
tne  correct  choices  have  no  recourse  but  to  use  the  informa¬ 
tion  about  the  proportion  of  Eq  events  if  they  wish  to  improve 
performance  over  that  attainable  by  responding  on  the  basis 
of  the  conditional  probabilities.  For  some  stimuli  the  con¬ 
ditional  orobability  of  the  stimulus  given  Eq  is  greater  than 
the  conditional  probability  of  the  stimulus  given  E^.  The 
reverse  is  true  for  other  stimuli.  An  S  who  always  chooses 
his  response  according  to  which  event  produces  the  greater 
conditional  probability  is  responding  on  the  basis  of  the 
conditional  probabilities. 
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CHAPTER  III 


EXPERIMENTAL  METHOD 

The  Task, — The  Ss  were  given  a  brief  explanation  of  the 
problem  confronted  by  a  physician  Vvho  must  recommend  treat¬ 
ment  for  an  ailment  when  he  is  not  sure  exactly  what  the  ail¬ 
ment  is.  The  following  situation  was  then  described  to  the 
S s :  The  result  of  a  blood  analysis  shows  that  each  of  a 
group  patients  has  one  and  only  one  of  two  possible  strains 
of  a  certain  virus.  However,  exactly  which  strain  each  pa¬ 
tient  has  is  not  known  since  the  blood  test  cannot  discri¬ 
minate  between  the  two  strains.  The  two  strains  are  labeled 
virus  Y  and  virus  0.  When  a  patient  is  presented  for  diag¬ 
nosis  he  reports  a  symptom,  and  the  task  is  to  prescribe 
the  appropriate  treatment  for  the  patient.  There  is  one 
drug  which  is  effective  in  curing  a  patient  who  has  virus  Y, 
and  another  drug  which  is  effective  in  curing  a  patient  who 
has  virus  0.  Since  the  drugs  interact  in  a  potentially 
harmful  way,  both  drugs  cannot  be  administered  to  a  single 
individual.  The  possible  symptoms  which  a  patient  may 
report  are:  Headache,  Sore  Throat,  Nausea,  Fever,  Drowsi¬ 
ness,  or  Backache.  (The  complete  instructions  for  each 
group  appear  in  Appendix  II.) 

Subjects. — The  Ss  were  163  volunteer  undergraduate 
students  from  an  introductory  psychology  course.  The  ratio 
of  male  to  female  was  about  six-to-one.  The  Ss  were  run  in 
six  groups,  each  group  corresponding  to  one  of  the  three 
experimental  settings  with  Eq  defined  as  virus  Y  for  roughly 


half  of  each  condition,  and  defined  as  virus  0  for  the 
other  half.  The  Ss  were  randomly  assigned  to  conditions  with 
the  constraint  that  some  Ss  were  free  to  schedule  exoerimen- 
tal  meetings  only  at  one  particular  time.  This  latter  con¬ 
dition  characterized  about  25  Ss  who  were  approximately 
equally  distributed  among  the  six  groups.  Originally  there 
were  30  Ss  scheduled  for  each  group,  but  some  Ss  failed  to 
keep  the  appointment.  It  was  decided  that  the  utility  of 
having  equal  numbers  in  each  group  was  overshadowed  by  the 
disutility  of  finding  more  Ss  and  running  these  Ss  In  small 
groups  of  two  or  three.  The  number  of  Ss  in  each  group  was 
as  follows :  CC-O,  25;  CC-Y,  23;  CP-CC-O,  30;  CP-CC-Y,  27; 
CP-CC-0,  29;  CP-CC-Y,  28.  (One  S  was  discarded  from  ^roup 
CC-Y  because  he  used  the  stimulus-free  strategy  of  systema¬ 
tically  writing  down  10  AQ  responses,  10  A.^  responses,  etc.) 

Stimulus-Correct  Choice  Series. — A  Bernoulli  process  was 
simulated  on  an  LGP-30  computer  to  generate  the  sequence  of 
events  using  the  multiplicative  congruential  method  (Tauslcy 
and  Todd,  1956).  The  probability  that  Eq  occurs  on  a  given 
trial,  IIq ,  was  .80.  In  order  to  generate  the  stimuli,  the 
conditional  probabilities  were  obtained  by  using  two  binomial 
processes  with  (n  =  5')  ahd  letting  the  number  of  successes 
each  represent  a  symptom.  That  is,  no  successes  was  substitu¬ 
ted  for  a  headache,  one  success  for  sore  throat,  .  .  .,  and 
five  successes  for  a  backache.  When  EQ  was  the  event  for  a 
given  trial,  the  binomial  process  had  a  parameter  (p  =  .65), 
while  with  (p  =  .40).  The  same  process  as  described  above 
was  used  to  generate  the  values  of  r,  the  number  of  successes 
in  a  sample  of  size  five.  The  theoretical  condition,  margi¬ 
nal  and  posterior  probabilities,  and  the  marginal  and  pos- 
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terior  probabilities • obtained  from  the  seouence  which  was 
used  in  all  conditions  are  given  in  Table  1.  The  equation 
for  the  marginal  probabilities,  f ( r | ,  is 

f(r|n0)  =  nQf(r|n,p0)  +  (1  -  HQ)f  (r  In^) . 

The  posterior  probabilities  are  obtained  from  equation  (7) 
(7)  f(pQ|r)  =  nQf (n|p0)/[nQf (r |pQ)  +  (1  -  nQ)f(r|p1)]. 

TABLE  1 

THEORETICAL  CONDITIONAL,  MARGINAL,  AND  POSTERIOR 
PROBABILITIES,  AND  OBSERVED  MARGINAL  PROBABILITIES 

lip  =  .80,  pQ  -  .65,  p-j^  =  .40,  n  =  5 


r 

f(r|p0) 

f  (r  Ip^ 

f(r|nQ)  Observed 

f(pQ|r)  Observed 

0 

.005 

.078 

.020 

.053 

.213 

.250 

1 

.049 

.259 

.091 

.100 

.430 

.467 

2 

.181 

.346 

.214 

.200 

.677 

.700 

3 

.336 

.230 

.315 

.287 

.854 

.907 

4 

.312 

.077 

.265 

.267 

.942 

.951 

5 

.116 

.010 

.095 

.093 

.973 

1.000 

Procedure 

. — The  name  of  each1 

symptom  was  printed  with 

black 

ink  in  1 

1/2"  high 

letters  on  a  9" 

high  by  20 

"  wide 

white 

card.  These  cards 

were  hun - 

along 

the  too  of 

the 

blackboard  at 

the  beginning  of  the 

experiment  and  remained 

there 

throughout  the  experiment. 

The  name  of  each 

of  the 

strains  of  virus  was  printed  in  1 

1/2"  high  letters 

on  a 

5"  high  by  12" 

wide  card 

.  The  color  was 

black  for 

the  CC 

groups,  and  one  name  was  in  blue  and  one  in  red  for  the  CP-CC 
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and  CP-CC  grouos.  The  reason  for  this  will  be  explained  in 
a  moment.  These  cards  were  hung,  one  above  the  other,  on  a 
stand  in  front  of  the  experimenter. 

Each  S  was  given  an  answer  booklet  and  a  oencil.  The 
answer  booklet  was  composed  of  four  pages  each  of  which  had 
space  for  recording  the  first  letter  of  the  symptom  presented 
on  the  trial,  a  space  for  S  to  record  his  choice,  and  a  space 
to  record  the  correct  choice.  The  space  for  recording  the 
correct  choice  was  omitted  from  the  answer  sheets  for  the  CP- 
CC  groups. 

The  basic  nature  of  the  task  was  explained  to  all  Ss. 

The  Ss  were  told  that  if  the  strain  of  virus  which  a  oatient 

had  was  correctly  identified,  the  patient  would  recover  in  .a 

feu  hours,  but  if  the  strain  was  not  correctly  identified, 

the  patient  would  not  recover  for  a  few  days.  The  Ss  were 

told  that  they  could  not  be  correct  in  every  case,  but  it 

was  important  to  try  to  be  right  as  often  as  possible. 

The  Ss  in  the  CC  groups  were  simply  told: 

As  the  experiment  proceeds  you  may  see  that  Virus 
0  is  associated  with  some  symptoms  more  often  than 
is  Virus  Y,  On  the  other  hand,  you  may  see  that 
Virus  Y  is  associated  with  other  symptoms  more  of¬ 
ten  than  is  Virus  0.  Your  task  is  to  make  a  choice 
on  each  trial,  and  to  try  to  be  correct  as  often 
as  you  can. 

After  the  general  instructions  were  read  to  the  Ss  in 
the  CP-CC  and  CP-CC  groups,  a  figure  which  contained  the  con¬ 
ditional  probabilities  on  a  12"  high  by  18"  wide  white  card 
was  hung  at  the  top-center  of  the  blackboard.  The  symptoms 
which  had  greater  conditional  probabilities  for  Eq  were  to 
the  right  of  the  figure,  while  the  other  symptoms  were  to  the 
left  of  the  figure.  The  order  of  the  symptom  cards  from  left 


to  right  was  in  agreement  with  the  order  in  which  the  symptoms 
appeared  on  the  figure.  This  order  corresponded  to  the  nu¬ 
merical  ordering  on  r.  (The  order  of  symptoms  from  left 
to  right  for  the  CC  groups  was  a  random  order  of  this  con¬ 
figuration.)  The  figure  contained  the  first  letter-of  each., 
symptom.  Above  each  letter  there  were  two  half-inch  wide 
rectangles,  one  blue  and  one-red.  The  height,  of  ..the.  blue  rec¬ 
tangle  was  proportional  to  the  conditional  probability  of 
that  symptom  given  that  the  patient  had  the  strain  of  virus 
designated  as  Eq,  while  the  height  of  the  red  rectangle  was 
proportional  to  the  conditional  probability  of  that  symptom 
given  that  the  patient  had  the  virus  designated  as  The 

constant  of  proportionality  was  approximately  1"  =  .05.  The 
role  of  Eq  and  was  reversed  by  having  the  word  "Virus  Y" 
in  blue  for  one  group,  and  in  red  for  the  other  group. 

The  Ss  were  told  that  the  records  of  a  thousand  patients 
who  were  known  to  have  virus  Y  and  of  a  thousand  patients  who 
were  known  to  have  virus  0  had  been  obtained.  The  figure 
represented  the  number  of  patients  with  each  virus  who  repor¬ 
ted  each  symptom.  It  was  pointed  out  that  it  might  have  been 
more  difficult  to  obtain  the  thousand  records  for  the  one 
strain  than  for  the  other  since  it  might  be  that  there  are 
more  people  with  the  one  strain  than  the  other.  The  Ss  were 
told  that  even  though  a  particular  symptom  nay  occur  more 
frequently  when  one  strain  is  known  to  be  present  than  when 
the  other  strain  is  known  to  be  present,  it  doeB  not  follow 
that  presence  of  the  symptom  would  more  likely  Indicate  the 
first  strain.  The  Ss  were  told  that  tney  should  consider  the 
overall  frequency  of  each  strain  in  making  their  choices. 

The  Ss  in  the  CP-CC  group  were  told  that  they  would  get  an 
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Idea  of  these  frequencies  since  the  correct  choice  would  be 
given  after  they  had  made  their  choices.  The  3s  in  the  CP-CC 
groups  were  told  that  they  would  get  an  idea  of  these  fre¬ 
quencies  by  paying  attention  to  which  symptoms  tended  to  oc¬ 
cur  more  frequently.  If  symptoms  favoring  Eq  tended  to  occur 
more  frequently  than  symptoms  favoring  E^,  it  would  Indicate 
that  Eq  was  occurring  more  frequently  than  was  E^,  and  vice 
versa.  The  only  question  came  from  the  (CP-CC)  groups. 

There  was  some  protest  that  the  task  was  not  possible,  but 
the  experimenter  tried  to  clarify  the  task  by  rephrasing  the 
instructions. 

Each  trial  consisted  of  the  following  steps: 

1. )  The  experimenter  announced  the  trial  number,  took 

the  top  card  from  a  pre-arranged  pack,  read  the 
name  of  the  symptom  appearing  on  the  card,  and  poin¬ 
ted  to  the  appropriate  symptom  card  .at  the  top  of 
the  blackboard. 

4  J  * 

2. )  The  S  recorded  the  first  letter  of  the  symotom  and 

his  choice. 

3. )  Fifteen  seconds  after  the  initiation  of  step  1.), 

the  experimenter  read  the  name  of  the  correct  virus 
and  pointed  to  the  appropriate  card  containing  the 
virus  strain. 

4. )  The  S  recorded  the  correct  strain  on  his  answer 

sheet. 

5. )  Five  seconds  after  the  initiation  of  step  3.),  the 

next  trial  was  announced. 

For  the  CP-CC  groups,  steps  3.),  4.),  and  5.)  were  ommitted 
and  there  was  a  fifteen  second  inter-trial  interval.  A  stop 
watch  was  used  to  time  the  intervals  in  all  cases. 

Six  practice  trials  were  given.  Each  symptom  was  pre¬ 
sented  once  during  the  practice  trials,  but  no  correct  choices 
were  given.  The  experimenter  merely  indicated,  where  appro¬ 
priate,  how  this  would  be  done  during  the  experiment. 
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At  the  terminaticr  of  the  150  trials,  each  S  was  asked 
to  write  a  brief  paragraph  or  so  in  response  to  the  following 
questions . 

1. )  What  aoproach  did  you  use  in  making  your  decisions? 

2. )  If  you  were  to  perform  the  same  task  again,  do  you 
think  that  you  would  do  anything  differently?  If  so,  what? 

When  the  3s  had  finished  answering  the  above  questions, 
a  short  questionnaire  was  passed  out.  The  general  purpose 
of  the  questionnaire  was  to  try  to  get  some  further  infor¬ 
mation  relating  to  questions  1.)  and  2.)  above.  The  specific 
content  of  the  questionnaire  differed  slightly  from  one  group 
to  the  next,  but  the  general  content  was  the  same. 


-25- 


CHAPTER  IV 


RESULTS 

The  Results  to  be  presented  here  are  composed  of  two 
related,,  but  different,  translations  of  the  data.  The  first 
translation  is  in  the  form  of  cumulative  regret  functions. 

A  cumulative  regret  function  is  obtained  as  follows:  Assume 
that  the  payoff  for  a  correct  choice  is  one  unit,  while  the 
payoff  for  an  incorrect  choice  is  zero  units.  For  each  symp¬ 
tom  there  is  an  optimal  choice  defined  by  knowledge  of  the 
parameters  of  the  situation.  The  optimal  choice  is  the  choice 
which  has  the  higher  objective  expected  payoff,  and  the  choice 
A55  such  that 

E[p(A*)|s.]  =  uP«(Ej|si)  =  ?'(Ej\s±) 
is  greater  than  or  equal  to  1/2.  In  this  expression  uP’(Ejjs^) 
is  the  objective  expected  payoff  for  choosing  A- .  Reference 
to  Table  1  shows  that  the  optimal  choice  for  symptoms  H  and  S 
is  E^,  while  Eq  is  the  optimal  choice  for  J ,  F,  D  and  B.  The 
regret  for  a  particular  trial  is  the  difference  between  the 
objective  expected  payoff  for  the  optimal  choice  and  the  ob¬ 
jective  expected  payoff  of  the  choice  actually  made  by  the  S. 

If  S  makes  the  objectively,  optimal  choice,  the  regret  is  zero. 
If  S  does  not  make  the  objectively  optimal  choice,  the  regret 
is  non-zero,  and  is  small  whenever  E[p( A':*)  j-s^]  is  near  one 
half,  but  is  large  whenever  E[p(A") jsi3  is  near  one.  In  any 
case,  the  regret  is  a  function  of  the  choice  made  by  S  and  the 
objective  posterior  probability  of  the  event  given  the  stimu¬ 
lus.  The  regret  is 


(8)  g(sk)  =  E[p(A") | s± ]  -  E[p(A^)|s1] 
where  A^  is  the  choice  made  by  S.  The  cumulative  regret, 
G(si),  is  regret  summed  over  trials. 

The  second  translation  of  the  data  is  in  the  form  of  the 
proportion  of  Ss  making  the  optimal  choice  for  each  symptom. 
This  choice  is  for  H  and  S,  and  is  EQ  for  iJ,  P,  D  and  3. 

The  cumulative  regret  function  for  each  group  is  pre¬ 
sented  in  Fig.  1,  together  with  the  regret  function  obtained 
from  the  optimal  model  for  CC  and  CP-CC  conditions.  The  re¬ 
sponses  for  the  two  sub-groups  of  each  condition  were  pooled 
since  there  was  no  systematic  difference  which  could  be  ac¬ 
counted  for  in  terms  of  preference  for  responding  either  Y 
or  0.  The  solid  line  labeled  ’Model"  is  the  regret  function 
obtained  from  the  optimal  model  for  the  CC  condition.  The 
dashed  line  labeled  "Model"  is  the  regret  function  obtained 
from  the  optimal  model  for  the  CP-CC  condition  when  the  para¬ 
meters  of  the  initial  distribution  of  n  are  a  =  8  =  25.  The 
choice,  and  hence  the  regret,  for  this  condition  depend  upon 
the  choice  of  prior.  With  these  parameters,  95#  of  the 
density  of  the  beta  prior  distribution  is  between  .36  and  .64, 
while  99#  of  the  density  is  between  .32  and  .68.  This  value 
was  chosen  for  a  and  3  because  the  optimal  model  based  on  this 
prior  distribution  generates  a  regret  function  which  is  very 
similar  to  the  data  of  some  3s.  This  will  be  clarified  later. 

The  cumulative  regret  function  labeled  "Fig."  in  Fig.  1 
is  generated  by  always  choosing  that  response  which  has  the 
higher  conditional  probability  as  indicated  by  the  figure 
presented  during  the  experiment.  This  strategy  results  in 
optimal  choices  in  all  cases  but  symptom  U.  The  conditional 
probability  generated  by  is  greateri.than  the  conditional 
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CUMULATIVE  REGRET 


TRIAL  NUMBER 

Pig.  1.  Cumulative  regret  function  for  each  group  and  for 
optimal  model  for  each  condition.  Group  CC(n  =  48) ,  Group  CP-CC 
(N  «  57)  and  Group  CP-00  (N  =  57). 


-28- 


probability  generated  by  EQ,  but  the  value  of  nQ  is  such  that 
the  optimal  choice  is  AQ. 

The  regret  function  for  the  optimal  model  for  the  CP-CC 
condition  is  not  presented  in  Pig.  1.  Since  no  simole  expres¬ 
sion  can  be  found  for  the  mean  of  the  distribution  of  for 
this  condition,  it  was  necessary  to  use  a  high  speed  compu¬ 
ter  to  evaluate  the  mean.  Reference  to  Appendix  I  shows  that 
the  mean  of  this  distribution  is  the  ratio  of  two  polynomials. 
For  a  =  8  =  1,  the  polynomial  in  the  numerator  is  of  degree 
(i.  +  2),  and  the  polynomial  in  the  denominator  is  of  degree 
( Z  +  1).  With  existing  facilities  (LGP-30),  the  computing 
time  required  to  evaluate  this  function  is  tremendous.  The 
mean  was  computed  for  the  first  fifty-four  trials,  and  the  mo¬ 
del  made  one  non-optimal  choice.  This  was  for  symptom  N  on 
trial  37.  The  mean  of  the  distribution  was  well  above  the 
critical  value  necessary  to  choose  AQ  for  symptom  II,  and  it 
is  almost  certain  that  the  model  would  make  no  more  non- 
optimal  choices.  It  would  be  interesting,  but  impractical 
with  existing  facilities,  to  compute  the  mean  of  this  distri¬ 
bution  for  each  trial  using  the  values  of  a  and  8  which  were 
used  for  the  CP-CC  condition,  (<*=$  =  25).  It  seems  a  cer¬ 
tainty  that  the  only  non-optimal  choices  which  would  be  made 
would  be  for  symptom  N.  This  cannot  be  oroved,  but  an  intui¬ 
tive  argument  can  be  given.  With  a  =  6  =  1,  the  mean  of  the 
distribution  is  always  above  .50  except  after  trial  two,  and 
the  mean  does  not  get  near  the  value  necessary  to  choose  Aq 
for  symptom  S.  This  latter  value  is  .842.  When  a  =  6  =  25, 
95/5  of  the  density  is  between  .36  and  .64.  The  effect  of  this 
on  the  mean  of  the  distribution  of  n.  will  be  to  keep  it  clo- 

X/ 

ser  to  .50.  That  is,  it  requires  more  observations  to  move 
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the  mean  up  from  .50  in  this  case  than  when  a  =  3  =  1.  Hence 
there  should  be  more  non-optlmal  choices  for  symptom  N,  but 
this  is  the  only  difference  to  be  expected. 

During  the  early  trials  the  empirical  functions  for 
Groups  CC  and  CP-CC  are  very  similar  to  the  model  functions, 
For  Group  CP-CC,  this  simply  means  that,  during  the  early 
trials,  both  model  and  subject  make  their  choices  in  a  man¬ 
ner  consistent  with  the  response  indicated  by  the  conditional 
probabilities.  On  the  other  hand,  Ss  in  Group  CC  distribute 
their  responses  about  equally  between  Aq  and  during  the 
early  trials  as  does  the  model. 

The  optimal  model  for  the  CP-CC  condition  makes  all  op¬ 
timal  choices  after  trial  ^2,  while  the  optimal  model  for  the 
CC  condition  makes  a  few  non-optimal  choices  after  trial  35. 
This  latter  fact  is  attributable  to  the  sequence  of  events 
associated  with  symptom  S,  On  the  other  hand,  tne  empirical 
functions  increase  beyond  these  points.  The  functions  for 
Groups  CC  and  CP-CC  are  virtually  identical,  are  somewhat  S- 
shaoed,  and  are  similar  in  increase  to  the  "Fig."  function. 
The  function  for  Group  CP-CC  is  linear.  The  performance  of 
the  latter  group  is  poorer  than  that  of  tne  other  two  ^rouos. 

There  is  little  more  to  say  about  the  results  in  this 
form.  The  empirical  functions  presented  in  Fig.  1  are  aver¬ 
aged  over  Ss,  and  it  is  important  to  try  to  assess  tne  con¬ 
tribution  of  each  S  to  the  average.  In  order  to  achieve  some 
understanding  of  this  contribution  of  each  S,  the  cumulative 
regret  function  of  each  individual  was  inspected.  Tables  of 
the  individual  regret  functions  evaluated  at  five-trial  in¬ 
tervals  are  presented  in  Appendix  III.  The  figures  are  not 
presented  here  because  the  result  of  plotting  several  of 
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these  functions  in  one  figure  is  utter  confusion,  and  the  bur¬ 
den  of  presenting  162  figures  is  overwhelming.  Inspection 
of  the  individual  curves  for  groups  CC  and  CP-CC  revealed 
that  the  curves  could  be  roughly  classified  into  three  cate¬ 
gories  by  looking  at  the  shape  of  the  function  between  trials 
51  and  100,  and  between  trials  101  and  150.  There  were  some 
curves  which  were  relatively  smooth  or  flat  throughout  both 
intervals  (FF).  Some  were  smooth  between  trials  51  and  100 
but  increased  between  trials  101  and  150  (PI),  while  others 
increased  through  both  intervals  (II).  About  half  of  the 
Ss  in  the  CP-CC  group  made  every  choice  according  to  which 
conditional  probability  was  greater  as  seen  on  the  figure 
presented  to  the  Ss.  The  rest  of  the  Ss  in  this  grout*  could 
be  classified  as  (II),  with  one  exception.  This  S  made  two 
non-optimal  choices  throughout  the  experiment.  Of  the  30 
times  symptom  N  occurred,  this  3  made  the  non-optimal  choice 
in  two  cases.  There  were  nine  Ss  in  the  CP-CC  vroun  who 
made  the  choice  indicated  by  the  conditional  probabilities 
on  each  trial. 

The  judgments  of  flat  versus  increasing  were  made  by 
the  experimenter  by  two  methods,  and  by  an  independent  judge 
using  one  method.  The  method  used  by  both  judges  was  visual 
inspection,  while  the  experimenter  also  used  a  numerical  me¬ 
thod.  If  the  difference  in  a  cumulative  regret  function  was 
greater  than  two  units  between  the  two  limits,  either  51-100 
or  101-150,  the  function  was  considered  to  be  increasing  be¬ 
tween  the  limits.  Otherwise  it  was  considered  to  be  flat. 

This  arbitrarily  chosen  value  represents  a  value  which  is  not 
too  far  from  the  increase  for  the  optimal  CC  model  but  not 
too  near  the  increase  for  the  probability  matching  model. 
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This  categorization  rule  was  violated  in  two  cases  in 
which  the  result  oi’  categorization  was  an  increasing  curve 
between  trials  51  and  101  and  a  flat  curve  between  trials 
101  and  150.  The  amount  of  increase  in  the  interval  51-100 
was  onlj.  slightly  larger  than  the  selected  value  of  two  some¬ 
what  independent  judgments  of  the  experimenter,  and  the  inde¬ 
pendent  judgments  of  the  other  rater  agreed  almost  without 
exception.  (If  the  reader  turns  to  Appendix  III,  he  will  see 
why  this  is  so.  The  individual  differences  are  by  no  means 
small . ) 

Cumulative  regret  functions  for  the  three  groups  with 
the  sub-divisions  explained  above  are  presented  in  Figs.  2, 

3,  and  4.  The  curves  for  various  models  are  also  presented. 

The  results  of  the  CC  group  are  presented  in  Fig.  2.  The  cu¬ 
mulative  regret  function  for  Ss  classified  as  FF  (N  =  19)  is 
identical  to  the  model  function  in  many  regions,  and  overall 
it  is  very  similar  to  the  model  function.  There  is  somewhat 
more  increase  in  the  empirical  function  between  trials  85  and 
120  than  in  the  model  function.  The  function  for  Ss  classi¬ 
fied  as  FI  (N  =  10)  is  everywhere  above  the  function  of  the  FF 
group,  but  is  very  similar  up  to  trial  100.  The  function  for 
Ss  classified  as  II  (N  =  19)  is  very  similar  to  the  function 
labeled  "Matching"  in  Fig.  1.  The  matching  function  was  generated 
assuming  that  for  each  trial  <5ik  is  the  probability  that  S 
chooses  Aq,  while  (1  -  6^)  is  the  probability  that  S  chooses  . 

The  results  of  the  CP-CC  group  are  presented  in  Fig.  3 
The  function  for  the  Ss  classified  as  FF  (N  =  12)  is  virtually 
identical  to  the  model  curve  up  to  trial  50,  but  this  should 
be  so  because  the  values  of  the  parameters  of  the  prior  dis¬ 
tribution  cannot  be  made  so  that  there  is  the  observed  in- 
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crease  during  the  initial  trials  and  also  the  observed  increase 
during  the  last  100  trials.  The  function  of  the  CP-CC-FF 
group  after  trial  50  is  more  similar  to  the  function  venerated 
by  the  model  for  the  CC  condition  than  the  function  generated 
by  the  model  for  the  CP-CC  condition. 

The  function  for  Ss  classified  FI  (iJ  =  12)  is  everywhere 
above  the  function  of  Ss  classified  PP.  The  two  functions 
are  very  much  the  same  up  to  trial  100,  but  at  this  point  the 
function  of  the  PI  group  increases  with  about  the  same  slone 
as  the  matching  function.  Here  again,  the  function  of  Ss 
classified  as  II  (H  =  23)  is  similar  to  the  matching  function. 
The  function  for  the  other  Ss  in  the  CP-CC  condition  (H  =  10) 
is  the  function  labeled  "Fig."  in  Fig.  3.  This  function  is 
generated  by  always  choosing  that  response  which  has  the 
higher  conditional  probability  as  indicated  by  the  figure 
presented  during  the  experiment.  This  strategy  results  in 
optimal  choices  in  all  cases  but  symptom  N.  In  the  case  of 
symptom  N,  E1  generates  the  higher  conditional  probability, 
but  the  value  of  nQ  is  such  that  the  optimal  choice  is  AQ. 

The  results  for  the  CP-CC  group  are  presented  in  Pig.  4. 
CNote  the  change  in  scale  to  accommodate  the  functions.)  The 
function  for  Ss  who  made  all  choices  in  agreement  with  the 
height  of  the  conditional  probabilities  CJ  =  32)  is  arain 
labeled  "Fig."  It  would  be  interesting  to  find  out  what 
values  of  a  and  e  (for  a  =  g)  would  generate  this  regret 
function  for  the  optimal  model.  Perhaps  25  is  not  too  far 
from  this  value.  There  was  one  S  who  made  only  two  non- 
optimal  choices.  This  S  stated  that  he  noticed  a  preponde¬ 
rance  of  symptoms  for  which  the  conditional  probabilities 
generated  by  EQ  were  greater  than  the  conditional  probabili- 
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ties  generated  by  E^,  and  that  he,  therefore,  decided  that 
the  better  choice  for  symptom  N  was  A^.  This  statement  is 
the  intuitive  spirit  of  the  model.  The  other  Ss  (N  =  24)  can 
be  classified  as  II  according  ot  the  scheme  described  ear¬ 
lier.  The  Ss  in  this  group  follow  the  figure  up  to  trial  10 
only.  Beyond  this  point  the  empirical  function  is  very  si¬ 
milar  to  a  cumulative  regret  function  obtained  by  a  condi¬ 
tional  probability  matching  model  (CP  Matching).  The  CP 
Matching  model  assumes  that  for  a  given  trial  S  chooses  Aq 
with  probability  p^  and  chooses  A^  with  probability  (1  -  p^), 
where 

p,(silEo) 

(9)  Pi  =  P  ’  ( [Eq  5  +  P^sjE") 

This  model  is  in  the  saae  spirit  as  a  probability  matching 
model  when  tl'je  correct  choices  are  given.  The  model  assumes 
that  S  apportions  hie  responses  between  Aq  and  A^  in  agree¬ 
ment  with  his  estimates  of  the  conditional  probabilities. 

The  cumulative  regret  function  for  the  three  sub-groups  of 
the  CC  and  CP-CC  conditions  are  presented  in  Pig.  5.  The  functions 
for  the  corresponding  sub-groups  of  the  two  conditions  are  very 
similar.  The  major  differences  occur  during  the  early  trials, 
and  reflect  the  difference  between  the  conditional  probabilities 
being  present  or  absent.  The  function  for  each  sub-group  of  the 
CP-CC  condition  is  everywhere  below  its  counterpart  for  the  CC 
condition.  The  greatest  difference  is  the  difference  be¬ 
tween  groups  CC-II  and  CP-CC-II.  This  is  to  some  degree  a 
function  of  the  classification  procedure.  A  regret  function 
can  be  flat  only  if  the  increase  is  less  than  two  units  be¬ 
tween  limits,  while  it  can-be  increasing  if  the  increase  is 
any  number  greater  than  two.  The  range  of  increases  between 
limits  can  be  checked  by  reference  to  Appendix  III. 
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Pig.  4.  Cumulative  regret  function  evaluated  at  5_ trial 
intervals  for  Groups  CP-CC-II  (N  =  2 4-)  and  CP-CC-Fig.  (N  =  32) 
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The  sources  of  differences  in  the  corresponding  regret 
functions  are  discovered  by  reference  to  the  figures  giving 
the  proportions  of  optimal  choices  for  each  symotom.  (The 
trial  numbers  in  each  figure  designate  the  trials  on  which 
the  stimulus  was  presented.  The  occurrences  of  are  shown 
near  the  bottom  of  each  figure.  On  all  other  trials  EQ  oc¬ 
curred.)  These  figures  present  trial-by-trial  fruessin'- 

curves.  Such  curves  reflect  what  Toda  (1962)  has  called  tne 

Xjl 

macro-structure  of  the  guessing  process. 

The  proportions  of  the  Ss  making  the  optimal  choices  in 
Groups  CC-FP  and  CP-CC-FF  are  presented  in  Figs.  6,  7,  8,  and 
9.  The  optimal  choice  for  symptoms  H  and  S  is  E^,  while  the 
optimal  choice  for  symptoms  N,  F,  D,  and  8  is  Eq.  The  results 
for  symptoms  H,  B,  N,  F,  and  D  are  virtually  the  same  for  the 
two  groups.  During  the  early  trials  Ss  in  the  CP-CC  group 
tend  to  give  the  response  indicated  by  the  conditional  proba¬ 
bilities  for  symptom  N,  while  Ss  in  the  CC  group  respond  ac¬ 
cording  to  the  sequence  of  events.  There  appears  to  be  some 
pattern  seeking  during  the  early  trials  by  Ss  in  the  CC  group. 
When  E^^  occurs  on  trial  29  after  having  occurred  twice  in 
succession  earlier,  there  is  a  large  reduction  in  the  propor¬ 
tion  of  optimal  choices.  The  Ss  in  the  CP-CC  group  tend  to 
be  influenced  by  the  large  difference  in  conditional  probabi¬ 
lities  for  the  two  events  for  symptom  S.  Jhile  the  choice 
proportion  for  Group  CC  goes  to  0$  in  agreement  with  the  e- 
vent  sequence,  the  choice  proportion  stays  near  50#  for  Group 
CP-CC. 

The  proportions  of  Ss  making  the  optimal  choices  for 
Groups  CC-FI  and  CP-CC-FI  are  presented  in  Figs.  10,  11,  12, 
and  13.  The  results  for  each  symptom  are  quite  similar  for 
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these  two  groups.  The  Ss  in  these  groups  tend  to  be  influ¬ 
enced  by  local  factors.  For  instance,  there  is  a  large  posi¬ 
tive  recency  effect  following  the  two  occurrences  of  for 
symptom  D  on  trials  118  and  121.  The  choices  for  symptom  N 
are  quite  erratic  with  the  same  positive  recency  effect  after 
the  three  occurrences  of  on  trials  9*J,  99,  and  101.  The 
choice  proportions  for  the  two  groups  for  symptom  S  are  some¬ 
what  closer  than  are  the  choice  proportions  for  the  same  symp¬ 
tom  for  the  FF  Ss,  but  the  Ss  in  Group  CP-CC  are  influenced 
by  the  conditional  probability  ratio.  The  data  indicate  that 
Ss  in  these  groups  are  influenced  by  local  factors. 

The  proportions  of  Ss  making  optimal  choices  for  Groups 
CC-II  and  CP-CC-II  are  presented  in  Figs.  14 ,  15,  16,  and  17. 
Fig.  14  shows  that  Ss  in  Group  CC-II  call  for  symptom  3 

even  though  EQ  has  occurred  on  every  trial.  Tne  Ss  in  Group 
CP-CC-II  tend  to  make  the  choice  indicated  by  the  conditional 
probabilities  while  Ss  in  the  CC-II  group  respond  at  a  level 
somewhat  less  than  probability  matching.  The  results  for 
symptoms  F  and  D  are  quite  similar  for  the  two  grouns,  but 
there  is  a  big  difference  in  symptom  N.  In  this  case,  Ss  in 
the  CP-CC-II  group  choose  E^  for  the  most  part,  while  3s  in 
the  other  group  choose  Eq  for  the  most  part.  In  essence  the 
CC-II  choice  proportions  for  symptom  il  resemble  probability 
matching  according  to  the  event  sequence,  while  the  CP-CC-II 
choice  proportions  resemble  probability  matching  according 
to  the  conditional  probabilities. 

As  mentioned  earlier  32  Ss  in  the  C'P-CC  rroun  made  the 
choice  indicated  by  the  conditional  probabilities  on  each 
trial.  Since  the  optimal  choice  proportions  for  these  Ss 
are  0 %  for  symptom  II  and  100/5  for  the  other  symptoms,  figures 
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Fig.  13.  Proportion  of  Ss  making  optimal  choice  for  symptom  Drowsiness 
Groups  CC-FI  (N  =  10)  and  CP-CC-FI  (N  =  12).  The  trials  on  which  E_  occurred 
are  marked  near  the  bottom  of  the  figure.  1 
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showing  these  proportions  are  not  presented.  One  £  called  A^ 
for  the  first  two  presentations  of  symntom  N,  but  made  the 
optimal  choice  on  all  other  trials.  The  choice  proportions 
for  the  remaining  Ss  (N  =  24)  are  presented  in  Firs.  18,  19, 
20,  and  21.  Inspection  of  these  figures  shows  that  the  pro¬ 
portion  of  optimal  choices  center  around  the  CP-.Iatching 
lines  for  symptoms  H,  S,  3,  and  N.  The  choice  proportions 
for  symptoms  F  and  D  are  somewhat  above  the  CP-Ilatching  lines. 
This  result  Indicates  that  Ss  in  Group  CP-CC-II  aoportion 
their  responses  for  each  symptom  according  to  choice  propor¬ 
tions  approximately  equal  to  those  obtained  from  the  condi¬ 
tional  probabilities. 

It  was  stated  earlier  that  6il  should  be  equal  to  one- 
half  for  each  symptom.  Although  no  strong  argument  is  to  be 
made  here  for  any  assumption,  is  is  rather  interesting  to 
look  at  the  choice  proportions  for  the  first  occurrence  of 
each  stimulus.  3y  trial  11  all  stimuli  had  occurred  at 
least  once.  The  proportion  of  Ss  who  cnose  Aq  on  each  of  the 
first  11  trials  is  presented  in  Table  2.  Tne  stimulus  and 
event  sequences  up  to  trial  11  are  also  presented. 

The  evidence  here  favors  the  suggestion  that  most  Ss 
choose  the  response  which  has  not  been  called  correct  for 
the  other  symptoms.  Of  course,  from  the  nature  of  the  in*- 
structions  the  Ss  are  justified  in  expecting  to  occur 
for  some  of  the  symptoms. 

The  information  obtained  form  the  questions  asked  after 
the  experiment  provide  little  information  relevant  to  the 
analysis  at  this  level.  These  results  will  not  be  presented. 
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TABLE  2 


PROPORTION  OF  Ss  CHOOSING  EQ  ON  THE  FIRST  11  TRIALS 


'  '  - 

Trial 

•  J  yj 

Symptom 

Proportion 

Event 

1 

B 

•58 

Eo 

2 

H 

.37 

E1 

3 

D 

.38 

Eo 

4 

D 

.88 

Eo 

5 

D 

.92 

Eo 

6 

D 

.94 

Eo 

7 

F 

°°l 

cm| 

• 

Eo 

8 

F 

1.00 

Eo 

9 

F 

1.00 

Eo 

10 

N 

.23 

Lo 

11 

S 

.25 

Eo 
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Pig.  18.  Proportion  of  Ss  making  optimal  choice  for  symptoms  Headache 
Sore  Throat,  and  Backache.  Group  CP-CC-II  (N  =  24).  The  dashed  lines  are 
the  CP  Matching  lines. 
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_ Pig.  20.  Proportion  of  Ss  making  optimal  choice  for  symptom  Fever.  Group 

CP-CC-II  (N  =  24).  The  dashed  line  is  the  CP  Matching  line. 


Fig.  21.  Proportion  of  Ss  making  optimal  choice  for  symptom  Drowsiness 
Group  CP-CC-II  (N  =  24).  The  dashed  line  is  the  CP  Matching  line. 


CHAPTER  V 


DISCUSSION  AND  SUMMARY 

The  conclusions  which  can  be  drawn  from  the  present  in¬ 
vestigation  depend  upon  the  level  of  data  analysis.  First, 
restricting  attention  to  the  cumulative  regret  functions 

•j 

based  on  the  responses  of  all  Ss  in  each  group,  there  is 
quite  a  discrepency  between  the  performance  of  the  Ss  and 
the  performance  of  the  optimal  model  for  each  condition. 

There  is  little  difference  between  the  performance  of  the 
group  in  tne  prototypic  probabilistic  discrimination  learn¬ 
ing  condition  (Group  CC)  and  the  grouo  in  the  task  modified 
by  presentation  of  the  conditional  probabilities  of  the  sti¬ 
muli  given  the  events  (Group  CP-CC).  The  performance  of  the 
group  in  the  condition  wnere  the  conditional  orobabilities 
are  given,  but  the  correct  choices  are  withheld,  (Group  CP-CC) 
is  poorer  than  the  performance  of  the  other  groups. 

Logically,  the  CC  condition  and  the  Cp-CC  conditons 
are  alike  in  every  aspect  except  that  the  conditional  pro¬ 
babilities  are  presented  in  the  CP-CC  condition.  Presenta¬ 
tion  of  the  conditional  probabilities  should  improve  per¬ 
formance  over  that  of  the  CC  condition,  but  the  results 
indicate  that  this  is  not  the  case.  The  degree  to  which 
performance  is  improved  by  presentation  of  the  conditional 
probabilities  is  a  function  of  the  initial  distribution. 

If  the  initial  prior  distribution  is  the  lar:?e  variance 
uniform  distribution,  it  requires  but  a  few  observations 
to  move  ff  over  the  critical  value  for  choosing  AQ  for 


symptom  N.  However,  as  the  variance  of  this  distribution  de¬ 
creases,  it  requires  more  observations  to  significantly  change 
n^.  This  would  suggest  that  the  differences  between  the  two 
groups  could  be  made  greater  if  the  prior  distribution  for  Ss 
in  the  CP-CC  group  could  be  experimentally  controlled.  For 
instance,  if  a  series  of  similar  decision  tasks  were  presen¬ 
ted  with  the  value  of  nQ  being  chosen  for  each  task  from  some 
distribution  known  to  S,  one  would  be  better  able  to  assess 
the  difference  between  performance  in  the  two  conditions. 

It  was  suggested  earlier  that  Ss  differ  with  respect  to 
the  decision  rule  employed.  Direct  evidence  for  this  sugges¬ 
tion  has  been  obtained  in  similar  tasks  such  as  those  reported 
by  Toda  (1962).  The  large  individual  differences  found  in 

cz 

the  present  experiment  support  this  contention.  Certainly,  it 
is  difficult  to  conceive  that  such  differences  could  be  the 
result  of  variation  within  a  unitary  process.  The  memory 
burden  has  been  relieved  by  allowing  S  to  keep  a  record  of 
stimuli  and  events.  There  was  little  possibility  for  misiden- 
tification  of  stimuli  or  events.  The  major  source  of  indivi¬ 
dual  differences  lies  in  the  decision  rule  adopted  by  different 
Ss.  There  is  nothing  here  which  will  help  to  decide  why  an  S 
chooses  one  decision  rule  over  another,  or  why  he  may  have 
changed  decision  rules  from  time  to  time.  The  choice  and 
change  of  decision  rule  are  related  to  S*s  original  perception 
of  the  task  which  he  is  to  perform,  to  changes  which  occur  in 
his  perception  of  the  task  as  a  function  of  experience,  to  his 
motivation,  to  his  willingness  to  use  any  mental  effort  to  for¬ 
mulate  a  rule  which  has  some  chance  of  success,  and  to  many 
other  processes  which  are  neither  fully  controlled  nor  under- 
stpod.  Classifying  Ss  according  to  the  shape  of  the  regret 
function  does  not  lead  to  groups  of  Ss  who  use  the  same  de- 
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cision  rule,  but  the  differences  are  at  least  reduced,  and 
the  result  Is  a  clearer  picture  of  the  differences  between 
the  CC  and  CP-CC  groups. 

More  information  about  these  differences  can  be  obtained 
from  the  groups  classified  as  PF  than  from  the  other  groups 
because  the  method  of  classification  assures  that  the  respon¬ 
ses  of  these  Ss  must  be  mostly  optimal  responses.  The  con¬ 
clusion  which  seems  most  warranted  is  that  there  is  not  a 
clear  understanding  on  the  part  of  the  Ss  concerning  the  roles 
of  overall  frequency  and  conditional  probabilities.  The  ini¬ 
tial  persistence  in  choosing  for  symptom  N  is  consistent 
with  the  idea  of  an  initial  prior  distribution  with  small 
variance,  but  the  change  in  response  proportion  over  trials 
for  symptom  S  is  not  consistent  with  this  idea.  Granted 
that  differences  exist  between  the  equations  and  numbers 
used  by  the  models  and  the  potentially  analogous  processes 
used  by  the  Ss,  and  that  there  remains  a  possibility  for  a 
process  similar  to  the  decision  rule  developed  for  condition 
CP-CC,  the  more  parsimonious  interpretation  consistent  with 
the  data  is  that  the  determinants  of  choice  are  the  ratio  of 
the  two  conditional  probabilities  and  the  event  sequence  for 
each  symptom.  That  is,  the  Ss  in  the  Cp-CC-PP  group  do  not 
seem  to  take  advantage  of  the  fact  that  the  only  information 
relevant  to  the  choice  is  the  overall  frequency  of  Eq .  On 
the  other  hand,  the  Ss  in  the  PP  groups  appear  to  treat  the 
task  as  it  is  constructed.  That  is,  they  seem  to  realize  that 
the  nature  of  the  event  sequence  is  stochastic,  and  they  are 
usually  not  disturbed  by  the  occurrences,  even  in  groups,  of 
the  less  frequently  occurring  event  for  a  particular  symptom. 

The  conditional  probability  matching  which  arises  from 
the  data  of  Ss  in  the  CP-CC  group  classified  as  II  is  rather 
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interesting,  but  somewhat  mysterious.  The  result  is  somewhat 
consistent  with  probability  learning  phenomena.  However,  it 
is  doubtful  that  it  could  ever  arise  as  a  prediction  from  pro¬ 
bability  learning  theory.  Although  Simon  (1957)  presents 
conditions  which  produce  probability  matching  as  behavior  con¬ 
sistent  with  a  minimax  regret  criterion  (not  regret  as  defined 
earlier  in  this  paper),  the  derivation  rests  on  the  knowledge 
of  results.  Of  course,  the  Ss  in  this  group  were  not  told 
which  event  occurred  on  each  trial. 

More  intriguing,  perhaps,  is  the  fact  that  over  half  of 
the  Ss  in  the  group  responded  consistently  in  agreement  with 
the  conditional  probabilities.  How  does  this  come  about?  An 
interesting  analysis  of  behavior  under  conditions  of  reduced 
validation  is  presented  by  Bruner,  Goodnow  and  Austin  (1957). 
One  task  which  they  consider  is  a  probabilistic  categorization 
task  which  is  very  similar  to  the  task  used  in  this  experiment 
The  primary  difference  is  that  certain  aspects  of  presented 
objects  provide  partially  valid  cues  for  the  purpose  of  cate¬ 
gorization,  but  more  than  one  cue  is  associated  with  each  ob¬ 
ject.  They  suggest  that  reduction  of  opportunity  to  validate 
choices  will  lead  to  a  reduction  in  problem  solving  activity 
in  the  sense  of  an  attempt  to  eliminate  error.  This  reduction 
in  problem  solving  activity,  they  suggest,  might  lead  to  an 
all-or-none  type  of  behavior  in  which  a  certain  margin  of  er¬ 
ror  will  come  to  be  accepted. 

Reference  to  the  statistical  structure  of  the  present 
task  yields  some  rather  interesting  facts.  Figure  22  presents 
the  expected  number  of  errors  in  150  trials  for  certain  stra¬ 
tegies  as  a  function  of  ilg.  The  two  lines  labeled  "Ag"  and 
"A^"  show  the  expected  number  of  errors  if  S  always  chooses 


-62- 


the  indicated  response.  For  instance,  if  IIq  is  zero  and  S 
always  chooses  Aq,  he  is  always  wrong;  while  if  IIq  is  one, 
he  is  always  correct.  The  curve  labeled  "optimal"  gives  the 
expected  number  of  errors  if  nQ  is  known  and  the  optimal 
choice  is  always  made  for  each  stimulus.  The  function  la¬ 
beled  "nQ  =  1/2"  gives  the  expected  number  of  errors  when  the 
choice  made  for  each  stimulus  is  in  agreement  with  the  as¬ 
sumption  that  n0  is  one-half. 

The  interesting  facts  are  that  the  expected  number  of 
errors  is  approximately  constant  and  that  there  is  a  con¬ 
siderable  region  in  which  the  difference  between  the  expected 
number  of  errors  for  the  "optimal"  curve  and  the  "IIq  =  1/2" 
function  is  negligible. 

This  does  not  explain  the  behavior  of  Ss  who  always  make 
the  choice  consistent  with  the  assumption  that  nQ  =  1/2. 

There  was  some  evidence  that  Ss  in  the  CP-CC  condition  did 
not  understand  the  role  of  the  overall  frequency  in  making 
their  choices.  If  this  is  the  case,  the  fact  that  there  would 
be  little  gain  from  trying  to  learn  n  q  if  the  decision  maker 
were  quite  convinced  that  it  was  somewhere  near  one-half  does 
not  bear  on  the  issue  either.  What  seems  to  happen  is  that 
S  does  not  seek  a  better  solution  but  uses  a  strategy  which, 
perhaps,  he  feels  cannot  be  too  disastrous. 

It  would  be  very  interesting  to  see  what  would  happen  in 
the  CP-CC  condition  if  the  Ss  were  told  beforehand  the  value 
of  IIq.  Certainly  if  it  were  0  or  1,  there  would  be  no  ques¬ 
tion.  However,  if  it  were  some  other  number,  there  would  be 
a  direct  opportunity  to  investigate  the  ability  of  Ss  to  com¬ 
bine  the  conditional  and  prior  probabilities.  As  mentioned 
before  Edwards  (personal  communication)  has  found  Ss  unable 
to  do  this  in  an  estimation  task. 
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Pig.  22.  Expected  number  of  errors  as 
function  of  IIq  for  three  different  strategie 
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The  primary  concern  here  is  not  whether  a  certain  stra¬ 
tegy  can  be  interpreted  as  "rational”  or  "irrational."  Cer¬ 
tainly,  if  all  the  constraints,  both  external  in  the  sense 
of  the  properties  of  the  decision  task  and  internal  in  the 
sense  of  the  ability  of  the  humans  to  perform  certain  func¬ 
tions,  his  motivation,  the  cost  to  him  for  seeking  out  a  more 
satisfactory  solution,  etc.,  were  known,  one  would  find  that 
his  behavior  was  consistent  with  these  constraints.  In  the 
work  reported  here,  the  effect  of  manipulating  certain  ex¬ 
ternal  constraints  has  been  analyzed.  In  order  to  make  this 
analysis  it  has  been  necessary  to  assume  that  the  internal 
environment  of  S  is  such  that  his  goal  is  the  achievement  of 
expected  payoff  and  that  he  is  capable  of  integrating  infor¬ 
mation  about  overall  frequency  and  conditional  probabilities. 
The  first  assumption  is  obviously  too  simple,  the  second 
may  or  may  not  be  valid.  However,  the  analysis  which  is  pos¬ 
sible  from  these  assumptions  is  helpful  in  understanding  the 
logical  differences  of  certain  choice  situations  and  provides 
a  sound  basis  for  comparing  the  performances  of  Ss  who  per¬ 
form  in  these  choice  situations. 

Summary . — A  decision-theoretic  analysis  of  three  related 
choice  situations  is  presented.  The  first  situation  is  a 
standard  probabilistic  discrimination  learrting  situation  (CC) 
In  this  situation  each  trial  begins  with  the  presentation  of 
one  of  a  set  of  six  stimuli.  The  S  must  choose  between  two 
response  alternatives  (AQ  or  A-^)  to  indicate  which  of  two  e- 
vents  (Eq  or  E^)  he  feels  will  occur  on  the  trial.  After 
making  his  choice,  S  is  told  which  of  the  events  occurred. 

The  second  situation  (CP-CC)  arises  when  the  conditional  pro¬ 
babilities,  the  probabilities  of  the  stimuli  given  the  events 
are  introduced  to  S  at  the  beginning  of  the  experiment.  The 
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third  situation  differs  from  the  second  only  in  that  S  is  not 
told  which  event  occurred  on  each  trial. 

The  decision-theoretic  analysis  shows  what  decision  rule 
should  be  used  in  each  situation  in  order  to  maximize  expected 
payoff.  This  analysis  shows  what  differences  in  performance 
would  be  expected  among  the  three  conditions,  in  terms  of  a 
strategy  designed  to  maximize  expected  payoff. 

In  the  (CC)  condition,  S  must  keep  track  of  the  relative 
frequency  of  EQ  events  for  each  stimulus.  In  the  CP-CC  and 
CP-CC  conditions  the  conditional  probabilities  are  given  at 
the  beginning  of  the  experiment.  Since  Bayes  Rule  can  be  used 
to  obtain  the  posterior  probabilities,  the  only  relevant  infor¬ 
mation  to  be  extracted  form  the  sequence  of  events  in  these 
conditions  is  the  overall  relative  frequency  of  Eq  events. 

The  differences  between  these  two  conditions  are  a  function 
of  the  source  of  this  information.  Knowledge  of  which  event 
occurred  on  each  trial  is  the  source  of  this  information  for 
the  CP-CC  condition.  For  the  CP-CC  condition  the  source  of 
this  information  is  the  conditional  probabilities  of  the 
stimuli  which  have  occurred. 

One  group  of  Ss  was  run  in  each  condition  with  the  over¬ 
all  relative  frequency  of  EQ  equal  to  .80.  The  performance  of 
the  CC  group  was  virtually  identical  to  that  of  the  CP-CC  group, 
while  the  performance  of  the  CP-CC  group  was  somewhat  worse, 
where  the  performance  measure  was  the  difference  between  the 
objective  expected  payoff  of  the  optimal  choice  and  the  choice 
made  by  S  on  each  trial. 

When  the  performance  curve  for  each  S  was  sketched,  the 
presence  of  very  significant  individual  differences  indicated 
that  a  more  meaningful  analysis  could  be  obtained  by  classify- 
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ing  each  S  in  one  of  three  subgroups  on  the  basis  of  the  ob¬ 
served  increase  in  the  performance  curve  after  the  initial 
trials.  The  proportion  of  optimal  choices  for  each  trial 
was  computed  for  each  subgroup  of  each  condition.  Although 
there  were  differences  among  the  subgroups,  comparisons 
of  the  choice  proportions  of  corresponding  subgroups  a- 
cross  conditions  for  the  CC  and  CP-CC  groups  indicated 
that  Ss  in  the  Cp-CC  group  did  not  integrate  information 
concerning  the  overall  relative  frequencies  of  events 
and  conditional  probabilities. 

The  data  from  the  CP-CC  group  revealed  that  a  large  pro¬ 
portion  of  Ss  made  every  choice  in  agreement  with  an  assump¬ 
tion  that  the  overall  relative  frequency  of  Eq  was  one  half. 
This  led  to  mediocre  performance.  The  performance  of  the 
other  Ss  in  this  group  was  worse;  the  choice  proportions 
of  this  group  reflected  probability  matching  on  the  basis 
of  the  conditional  probabilities. 
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APPENDIX  I 


DECISION-THEORETIC  ANALYSIS  0^  CHOICE  SITUATIONS 


The  three  choice  situations  to  be  analyzed  here  have  the 
folloitfing  aspects  in  common: 

1. )  There  exist  two  events,  Eq  and  E^.  On  each  trial 
one  and  only  one  of  these  events  occurs.  The  probability 
that  Eq  occurs  on  each  trial,  1Iq,  is  constant  and  the  trials 
are  independent. 

2. )  The  value  of  IIq  is  unknown  to  the  S  in  the  choice 
situation. 

3. )  The  S  does  not  know,  at  the  beginning  of  a  trial, 
which  event  occurred.  Rather,  he  sees  a  stimulus  on  each 
trial  and  must  decide  which  event  produced  or  generated  the 
stimulus.  If  he  decides  Eq  was  the  event,  he  chooses  Aq, 
and  if  he  decides  E^  was  the  event,  he  chooses  A^. 

4. )  The  stimuli  form  an  exhaustive  set  of  mutually  ex¬ 
clusive  elements.  =  {s^,  ,  sn>. 

5. )  The  distribution  of  stimuli  depends  only  upon  E^ , 
the  event  which  occurs.  The  distribution  of  stimuli  is 
fCs^jEQ)  for  Eq  and  f(si|E1)  for  E^.  When  Eq  occurs  on  a  gi¬ 
ven  trial  a  stimulus  is  selected  at  random  according  to  the 
scheme  Pr(S  =  s^|Eq)  =  fCs^lEg),  and  similarly  for  . 

6. )  The  payoff  to  S  for  choosing  alternative  A^  given 
that  event  E^  occurred  is  independent  of  the  stimulus  and 
is  given  in  the  matrix 
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The  only  restriction  is  that  u^  >  U£. 


These  are  the  boundary  conditions  common  to  all  three 
choice  situations.  In  order  to  proceed  it  is  necessary  to 
specify  the  performance  criterion  which  is  to  be  adopted.  The 
performance  criterion  to  be  used  here  is  the  maximization  of 
expected  payoff. 

The  objective  expected  payoff  for  choosing  Aq  when  s^ 
occurs  is 

■  A  I 

(1)  E[p(A())|s1]  =  U-jP^EqIs^  +  u2Cl-P'  (EQ|si)] 

=  P»  (Eq  |  Sj.)  ^  -  u2)  +  u2 

The  choice  which  maximizes  objective  expected  payoff  is  the 
choice  A*  such  that 

l 

(2)  E[p(A»)|s1]  -  E[p(A#)|s1]  >  0. 
or  when  P'(E*|s^)  -  P'CE^Is^)  >  0. 

Hence,  for  the  payoff  matrix  under  consideration,  the  choice 

P  •  V  / 

is  determined  by  the  event  which  has  the  greater  probability 
given  the  stimulus.  It  will  change  nothing  to  consider  a  pay- 
off  matrix  with  unity  in  the  main  diagonal  and  zeros  elsewhere, 
and  doing  this  will  simplify  the  exposition. 

The  three  choice  situations  or  decision  tasks  to  be  dis¬ 
cussed  here  arise  as  the  conditional  probabilities  and/or  exact 
knowledge  of  the  event  which  occurred  on  each  trial  are  pro¬ 
vided  or  withheld. 

Task  CC -  In  this  situation  S  knows  the  possible  stimuli 

to  be  presented,  but  does  not  know  the  conditional  distributions. 
After  making  his  choice  on  each  trial,  he  is  told  which  event 
occurred . 

Since  S  does  not  know  the  conditional  probabilities,  he  has 
no  real  basis  for  assuming  that  any  particular  subset  of  the 
stimuli  is  such  that  Aq  is  the  best  choice  for  these  stimuli  and 
that  A^  is  the  best  choice  for  the  other  stimuli.  The  S  should 
treat  each  stimulus  as  a  separate  decision  task  and  keep  a 
separate  account  of  the  sequence  of  events  for  each  stimulus. 
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For  instance,  consider  stimulus  s^  Since  S  does  not  know 
P’(Eq|s^),  some  method  must  be  used  which  will  account  for  S's  un¬ 
certainty  concerning  the  proportion  of  EQ  events  associated  with 
s^  One  way  to  do  this  is  to  expand  the  decision  problem  in  such  a 
way  that  the  states  of  nature  are  defined  as  the  possible  propor¬ 
tions  of  Eq  events,  for  stimulus  s^  which  the  experiment  might 
have  chosen.  Then,  if  S  always  chooses  Aq  for  s^,  his  payoff,  in 
the  long  run,  will  be  equal  to  the  product  of  P'(Eq|s^)  and  the 
number  of  times  stimulus  s^  is  presented.  Potentially,  any  number 
in  (0,1)  could  have  been  chosen  for  P’CEqIs^,  and  S  is  uncertain  as 
to  which  value  was  actually  selected.  In  order  to  express  this  un¬ 
certainty,  define  a  prior  distribution,  g(p1),  on  (0,1).  Here,  the 
random  variable  P1  represents  the  possible  values  of  P’(Eq|s1). 
Assuming  that  very  little  information  will  be  required  for  S  to 
change  his  opinion  concerning  the  true  value  of  P'CEqIs.^),  g(pi) 
will  be  represented  by  the  uniform  distribution  on  (0,1),  and  will 
be  written  as  a  beta  distribution  with  parameters  (r*  =  1,  n'  =2). 
Then  S's  expected  payoff  for  choosing  Aq  when  s^  is  presented  is 


E[p(A0)|si]  =  /  pjdpj^  =  1/2 
0 

after  stimulus  s^  has  been  presented  (k-1)  times,  Eq  has  occurred  r 
times  and  E^  has  occurred  (k-l-r)  times.  In  S's  view  the  proba¬ 
bility  of  an  Eq  event  on  any  trial  is  some  fixed,  but  unknown,  num¬ 
ber,  p^^  and  the  trials  are  independent.  The  distribution  of  Eq 
events  is  then  binomial  with  (k-1,  p^  and  the  posterior  distribu¬ 
tion  of  Pj^  is 


g( p,  |  r,k-l,r '  ,n'  )=  - - -  r'+r-l,,  -.n'-r '-l+(k-l)-r 

1  B(r'+r,n'-r'+k-l-r)pi  (1“pi) 

The  expected  payoff  to  S  for  choosing  Aq  on  trial  k  is 

E'Cp(Aq)  |  s,  ]= - - -  /  r’+rn  sn'-r*-l+(k-l)-r , 

0  1  B[r»+r,n'-r'+(k-l)-r]  0  pi  (1”pi)  dpi 


_  r'+r  _  . 

— ; —  “  °ik 

n'+k-l  1K 

the  mean  of  the  beta  posterior  distribution.  Since  S  makes  his 
choice  so  as  to  maximize  expected  payoff,  he  uses  the  following 
decision  rule. 
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DECISION  RULE  (CC) 


Choose  Aq  whenever  6ik  >  1/2 
Choose  A1  whenever  <  1/2 
Choose  Aq  with  probability  1/2  and  A^ 
with  probability  1/2  whenever  6..  =  1/2, 


The  subscript  i  refers  to  the  stimulus  and  k  refers  to  the 
number  of  times  that  particular  stimulus  has  been  presented. 

Task  CP-CC -  In  this  task  the  conditional  probabilities, 

P'Cs^jE^)  are  presented  to  S  at  the  beginning  of  the  experiment. 
The  S  is  told  which  event  occurred  after  he  has  made  his  choice 
on  each  trial. 

If  Uq,  the  proportion  of  Eq  events, is  assumed  to  be  one 
half,  the  choice  with  the  greater  probability  of  leading  to  acor- 
rect  decision  is  the  one  which  is  indicated  by  the  conditional 
probabilities.  That  is,  AQ  is  chosen  if  P’Cs^IEq)  iP^s^lE.^) 
and  A^  is  chosen  otherwise.  (The  task  is  constructed  so  that 
P'CsJEq)  ¥  P»(si|E0),  for  i  =  1,  2,  ...,  n.) 

In  this  case  S’ s  uncertainty  can  be  coded  as  uncertainty 
concenning  the  value  of  Uq.  Again  this  uncertainty  will  be 
represented  by  a  beta  distribution  on  (0,1),  The  random  vari¬ 
able  is  n,  the  potential  values  of  itn,  and  the  probability 

1  u 

density  function  is  - B-l/,  x8-l  . 

B(a,B)u  (1_1t) 

Consider  S’s  choice  on  the  nth  trial,  A  stimulus  is  pre¬ 
sented  which  will  be  called  stimulus  s^^  to  designate  the  member 
of  the  stimulus  set  which  was  presented  and  the  trial  number  on 
which  it  was  presented.  What  choice  does  S  make?  Since  his 
choice  is  determined  by  the  event  which  he  feels  is  more  likely 
to  occur,  it  is  necessary  to  consider  P^CEqIs^,  , 

the  probability  of  event  Eq  on  the  nth  trial  given  the  stimulus 
for  that  trial  and  the  preceeding  history  of  stimuli  and  events. 
This  represents  the  probability,  to  S,  that  event  Eq  will  occur 
on  the  nth  trial.  This  probability  is 


(3)  = 


P ( s i £  |  Eq ,s_£— i n_ i  P,(Eq  , E ^ 

■£  p(  sm  I  Ej  *— -n— l n— i ^ n ^ j  I ~n— 1  *  — n— l ^ 
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In  (3)  ££_1  is  the  vector  of  stimuli  which  occurred  on  the  first 
(£-1)  trials,  and  E£^1  is  the  vector  of  events  which  occurred  on  the 
first  (£-1)  trials. 

The  first  term  in  the  numerator  on  the  right  in  (3)  is 

(4)  p(s1a|e0,s4_1,ea-1)  =  p»(s14|e0) 

since  the  distribution  of  stimuli  is  completely  specified  when  the 
event  is  given. 

The  second  factor  in  the  numerator  is  P£(Eq  j££_^,E£  and  is 

(5)  =  l0  "S(«|8|1.1>Et.1)diT 

since  P£(E0|ir,sA-1,E4-1)  =  P(EQ  |  ir )  =  it 
In  turn 

.  ^  (s,  ijE,  Jir)g(  it) 


I 


■f(S£-1,E£-1|  IT  )  g(  TT  )  dTT 


Since  the  event  is  independently  and  randomly  selected  on  each 
trial  and,  once  known,  completely  specifies  the  distribution  of 
stimuli 


(6) 


P'(s11,E1|.)P'(812,E2|.)--,P'(s1  (,_1,eji_1|1.)s(i.) 

_j - 1  -  • 

/  P*  (S11,E1|  it ) P *  (s12,E2  |  it)  •  •  «P*  (s1  £_1,E£_1|  ir)g(ir)dir 


But 


(7)  P'(slk,Ek|ir)  =  P,(8lk|Ek,ir)P(Ek|ir) 

=  P,(slk|E0)ir 

=  P'Cs^lEj^Jd-tr) 
for  k  =  1,  2,  ...,  ( £  -  1). 


if  Ek  "  E0 


if  Ek  =  E, 
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Substituting  the  appropriate  terms  from  (7)  into  (6),  the 


terms  P*(s 


ik 


Eq)  and  P ' ( sik 


E.^)  cancel  in  numerator  and  denomi¬ 


nator  since  these  terms,  not  involving  ■n  in  the  denominator. 


can  be  taken  outside  the  integral  sign, 
comes 


Equation  (6)  then  be- 


(8)  gU|s£-1,  E£-1)  « 


r  , ,  x)l-l-r 
ir  ( 1-  it  ) 


g (  it ) /  /  nr(l-ir) 
0 


Jt-l-r 


g(  tt ) d 


where  r  is  the  number  of  times  Eq'  has  occurred  up  through  trial 

U  -  1). 

Substituting  (8)  into  (5)  gives 


(9)  Pj,(E0|s£_1,  Ez_1)  = 

1 

/ 


r+1/,  ->)i-l-r 

it  (1-tr) 


g(tr)d  /  /  7rr(  1— tt)  A“1’"rg(tr)d 

0 


Since  g(ir)  is  a  beta  distribution,  the  expression  in  (9) 
is  the  mean  of  a  beta  posterior  distribution  where  the  data 
generating  process  is  binomial.  This  posterior  distribution 
has  parameters  (a+r,  6+ji-l-r) , 


(10)  P^EqJs^,  Ea_1)  =  Trz  =  (r+a)/U-l+a+e). 

Substituting  these  results  back  into  (3)  the  final  result  is 

(U)  PjtEol8!,.*,.!.!*.!)  * 

The  decision  rule  is 

Choose  Aq  whenever  P 1 C si A | Eq ) » (s±^lEi) C1  -  *£)  >  1> 

Choose  otherwise. 

Rearranging  and  solving  for  ir^,  the  decision  rule  can  be  written 
Decision  rule  (CP-CC) 

Choose  Aq  whenever  >  P*  Cs±  &  |E1)/{P*  (siJt|E1)  +  P'^JEq)  , 
Thus  the  distribution  of  depends  only  on  the  sequence 
of  events  up  to  the  fcth  trial,  the  initial  prior  distribution, 
and  the  stimulus  which  is  presented  on  the  £th  trial.  The  de¬ 
cision  rule  is  fixed  by  the  initial  conditions,  and  is  the 
choice  determinant. 

Task  CP-CC -  In  this  task  S  is  given  the  conditional  proba¬ 

bilities,  but  he  is  not  told  which  event  occured  on  each  trial. 
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In  this  case  the  decision  rule  is  the  same  as  it  is  in  the  CP-CC 


task.  The  only  difference  is  the  distribution  of  n  .  The  distri¬ 
bution  for  the  CP-CC  is  obtained  in  exactly  the  same  manner  as  the 
distribution  for  the  CP-CC  ‘cask.  The  result,  of  course,  is  dif- 
ferent  since  the  actual  sequence  of  events  is  not  known.  The  re¬ 
sult  is  ^ 

Pf M  .  k"i  [P'<3lk|E0),+p-(3lk|E1)(i-,)].“-1(i-„)e-1 
U2J  gU|s&,a,e;  =  — - - - 

/  n  [P'(slk|E0)7r+  P»(sik|E1)(l-7r)]1ra’1(l-ir)e";Ldi 


The  final  result  to  be  shown  here  is  the  sense  in  which  +  ttq 
as  a  *►  »,  assuming  a  and  8  to  be  finite.  For  r  of  the  £_  trials, 
the  event  will  be  Eq,  and  for  (£.-  r)  trials  the  event  will  be  E^. 
Then 

EOl|Et>a,6>  =  (r  +  .)/(!*.«)  =  ><I>  +  I+S+r  • 

Since  lim[(  $,)/(  Jl+a+B)]  =  1, 

00 

lim[(a)/(«,+a+e)]  =  0^ 


convergence  is  assured  by  Bernoulli's  Theorem  (Brunk,  i960). 

Pr{|j  -  ttq  |  <  e}  1  as  £-»■»,  where  e  is  an  arbitrarily  small 
positive  number.  It  is  not  possible  for  this  author  to  show  con¬ 
vergence  of  it ^  to  irQ  in  the  CP-CC  task. 


vT 
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APPENDIX  II 


GENERAL  INSTRUCTIONS  FOR  EXPERIMENT 

I  am  sure  that  at  one  time  or  another  most,  if  not  all, 
of  you  have  visited  a  doctor  for  treatment  of  some  ailment. 

You  are  undoubtedly  aware  that  in  some  cases  the  doctor  is 
not  absolutely  certain  what  the  ailment  is,  but  his  Job  is 
to  prescribe  a  treatment  which  he  feels  will  cure  the  ailment. 
In  this  type  of  case  the  doctor  has  information  from  exami¬ 
nations  and  reported  symptoms  which  may  indicate  several  ail¬ 
ments.  He  recommends  a  treatment  on  the  basis  of  information 
available,  but  he  cannot  be  certain  that  his  diagnosis  is 
correct.  It  is  obviously  important  to  make  the  correct  diag¬ 
nosis  as  often  as  possible.  When  the  diagnosis  is  incor¬ 
rect,  varied  results  may  follow,  but  in  any  case,  there  is  a 
penalty  of  some  kind  for  being  wrong. 

I  am  interested  in  studying  how  people  learn  to  make 
decisions  in  situations  such  as  the  one  which  I  have  just  de¬ 
scribed.  In  order  to  study  certain  aspects  of  the  learning 
process,  I  want  each  of  you  to  place  yourself  in  the  role  of 
a  doctor  who  will  be  faced  with  a  series  of  decisions  in  a 
situation  which  is  far  less  complex  than  that  which  I  have 
just  described.  Let  me  explain  the  situation. 

There  is  a  certain  virus  whose  presence  in  an  individual 
can  be  detected  by  the  result  of  an  analysis  of  a  blood 
sample  from  the  person.  However,  it  is  known  that  two 
strains  of  the  virus  exist,  and  that  the  blood  test  yields 
the  same  result  no  matter  which  strain  of  the  virus  is 
present.  I  will  refer  to  the  one  strain  as  VIRUS  Y,  and  to 
the  other  strain  as  VIRUS  0.  It  is  not  possible  that  a 
single  person  is  simultaneously  affected  with  both  strains. 

It  is  important  to  try  to  establish  which  strain  is 
present  in  a  given  individual  in  order  that  the  proper  treat- 
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ment  can  be  given.  One  drug  has  been  developed  which  is  effective 
in  curing  a  patient  who  has  virus  Y,  while  another  drug  has  been 
developed  which  is  effective  in  curing  a  patient  who  has  virus 
0.  Neither  drug  is  effective  against  the  other  virus.  It  is 
not  possible  to  administer  both  drugs  to  a  single  patient  since 
the  two  drugs  interact  in  a  way  which  is  often  harmful.  If  the 
proper  drug  is  administered,  the  patient  will  be  well  in  a 
matter  of  a  few  hours.  If  the  proper  drug  is  not  administered, 
the  patient  will  be  incapacitated  for  a  few  days,  but  will  then 
recover.  In  any  case,  it  is  possible  to  tell  which  strain  of 
the  virus  was  present  in  the  patient  after  a  few  days  because 
of  the  reaction  in  the  patient.  Of  course,  it  is  then  too  late 
to  change  the  treatment. 

You  see  that  it  is  important  to  make  as  many  correct  diag¬ 
noses  as  possible.  If  your  decision  is  correct,  the  patient 
recovers  quickly.  He  is  able  to  continue  his  normal  daily 
activities,  and  he  is  satisfied  with  your  services.  If  you  make 
the  incorrect  decision,  the  patient  will  be  incapacitated  for  a 
few  days.  He  is  not  able  to  perform  his  normal  activities,  and 
he  is  not  very  satisfied  with  your  services.  You  will  never  be 
certain  when  you  make  a  diagnosis,  and  you  cannot  be  correct  in 
every  case.  You  should  try  to  be  correct  as  often  as  you  can. 

This  experiment  will  consist  of  a  series  of  trials.  You 
should  consider  each  trial  as  an  occasion  on  which  a  patient  is 
presented  to  you  for  diagnosis.  Prom  the  result  of  the  blood 
analysis  you  know  that  the  patient  has  one  of  the  two  strains  of 
virus.  The  patient  reports  a  symptom  which  will  help  you  in 
reaching  a  decision,  but  the  symptom  will  not  enable  you  to  make 
a  certain  diagnosis. 

.  •» 

ADDITIONAL  INSTRUCTIONS  FOR  CC  GROUP 

As  the  experiment  proceeds  you  may  see  that  virus  Y  is 
associated  with  some  symptoms  more  often  than  is  virus  0.  On 
the  other  hand,  you  may  see  that  virus  0  is  associated  with 
other  symptoms  more  often  than  is  virus  Y.  Your  task  is  •• 
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make  a  choice  on  each  trial  and  to  try  to  be  correct  as 
often  as  you  can. 

These  cards  on  the  blackboard  name  the  symptoms  which 
will  be  reported.  At  the  beginning  of  each  trial  I  shall 
announce  the  trial  number.  I  will  then  pick  up  one  of 
these  3x5  cards.  The  name  of  the  symptom  reported  by  the 
patient  is  written  on  the  card.  I  will  read  the  name  of 
the  symptom  and  point  to  the  appropriate  card  on  the  black¬ 
board.  You  should  enter  the  first  letter  of  the  symptom  in 
the  column  headed  SYMPTOM  on  your  answer  sheet.  You  should 
then  make  your  decision.  If  you  decide  that  the  patient  has 
virus  Y,  mark  a  Y  in  the  column  headed  CHOICE.  If  you  decide 
that  the  patient  has  virus  0,  mark  an  0  in  the  column  headed 
CHOICE.  You  will  be  given  fifteen  seconds  to  record  the 
first  letter  of  the  symptom  and  to  make  and  record  your  choice. 
Be  sure  that  you  make  your  choice  within  this  time  limit. 

We  will  have  a  few  practice  trials  so  that  you  can  get  used 
to  the  pacing. 

After  you  have  made  and  recorded  your  choice,  that  is, 
after  the  fifteen  seconds,  I  will  tell  you  which  strain  of 
virus  the  patient  had.  I  will  do  this  by  reading  the  word 
on  the  3x5  card  which  contained  the  symptom.  I  will  also 
point  to  the  appropriate  card  on  the  blackboard.  Record 
this  letter  on  your  answer  sheet  in  the  column  headed  VIRUS. 
Five  seconds  after  I  have  done  this,  I  will  proceed  with 
the  next  trial. 

Please  do  not  try  to  see  what  choices  your  neighbors  are 
making,  and  do  not  indicate  by  expression  or  sound  whether  you 
have  made  the  correct  or  wrong  choice  on  any  trial.  Do  not 
become  discouraged  if  you  are  wrong  in  some  cases.  It  is 
impossible  to  be  right  in  every  case.  Remember  that  it  im¬ 
portant  to  be  correct  as  often  as  you  can. 

Are  there  any  questions  concerning  what  you  are  supposed 
to  do?  Be  sure  to  ask  me  now  if  you  do  not  understand  what 
you  are  to  do. 


-77- 


We  will  now  proceed  with  the  practice  trials.  At  the  comple¬ 
tion  of  these  practice  trials  I  will  answer  any  further  ques¬ 
tions  which  you  may  have. 

Are  there  any  further  questions?  Be  sure  to  ask  any  ques¬ 
tion  which  is  related  to  what  you  are  to  do  if  you  have  any  doubts. 

ADDITIONAL  INSTRUCTIONS  FOR  CP-CC  GROUP 

This  figure  on  the  blackboard  will  help  you  in  making  your 
decisions.  Let  me  explain  the  meaning  of  this  figure.  Clinics 
throughout  the  country  have  kept  records  for  thousands  of  pa¬ 
tients  who  have  had  the  virus  in  which  we  are  interested.  These 
records  tell  which  strain  of  virus  each  patient  had  and  which 
symptom  was  reported  by  the  patient.  As  I  have  said  before,  it 
is  possible  to  tell  which  strain  of  virus  a  particular  patient 
had  a  few  days  after  treatment  has  been  administered.  From  all 
of  these  records,  the  records  of  a  thousand  patients  who  were 
known  to  have  virus  Y  were  selected  and  the  records  of  a  thousand 
patients  who  were  known  to  have  virus  0  were  selected.  This 
figure  on  the  blackboard  was  prepared  using  these  records. 

Now  consider  only  the  records  of  the  thousand  patients  who 
were  known  to  have  virus  0.  The  height  of  the  blue  rectangle 
above  each  symptom  is  proportional  to  the  number  of  patients  with 
virus  0  who  reported  that  symptom.  For  instance,  of  the  thousand 
patients  who  had  virus  0  more  reported  FEVER  than  any  other  symptom, 
DROWSINESS  was  the  next  most  frequent  symptom  reported  by  the 
thousand  patients  who  had  virus  0.  Finally  of  the  thousand  pa¬ 
tients  who  had  virus  0  fewer  reported  HEADACHE  than  any  other 
symptom. 

Now  consider  only  the  records  of  the  thousand  patients  who 
were  known  to  have  virus  Y.  The  height  of  the  red  rectangle  above 
each  symptom  is  proportional  to  the  number  of  patients  with  virus 
Y  who  reported  that  symptom.  For  instance,  of  the  thousand  pa¬ 
tients  who  had  virus  Y  more  reported  NAUSEA  than  any  other  symptom. 
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SORE  THROAT  was  the  next  most  frequent  symptom  reported  by 
the  thousand  patients jwho  had  virus  Y.  Finally  of  the 
thousand  patients  who  had  virus  Y  fewer  reported  BACKACHE 
than  any  other  symptom. 

Although  this  figure  is  based  upon  the  records  of  a 
thousand  patients  who  were  known  to  have  virus  Y  and  a  thousand 
patients  who  were  known  to  have  virus  0,  it  does  not  neces¬ 
sarily  mean  that  it  was  as  easy  to  get  the  thousand  records 
for  the  one  virus  as  for  the  other,  easy  in  the  sense  that 
there  may  have  been  more  patients  who  were  found  to  have  the 
one  strain  of  virus  than  there  were  to  have  the  other  strain. 
You  should  consider  the  overall  frequency  of  each  strain  of 
virus  in  making  your  decisions.  Although  a  particular  symptom 
may  occur  more  frequently  when  one  strain  of  virus  is  present 
than  when  the  other  strain  is  present,  it  does  not  neces¬ 
sarily  follow  that  that  first  strain  of  virus  is  more  likely 
when  the  symptom  occurs.  So,  in  making  your  diagnoses  you 
should  consider  the  overall  frequency  of  each  strain  of  virus. 

You  will  get  an  idea  of  these  frequencies  since  I  will 
tell  you  which  strain  of  virus  each  patient  had  after  you  have 
made  and  recorded  your  choice.  Your  task  is  to  make  a  choice 
on  each  trial  and  to  try  to  be  correct  as  often  as  you  can. 

These  cards  on  the  blackboard  name  the  symptoms  which 
will  be  reported.  At  the  beginning  of  each  trial  I  shall 
announce  the  trial  number.  I  will  then  pick  up  one  of  these 
3x5  cards.  The  name  of  the  symptom  reported  by  the  patient 
is  written  on  the  card.  I  will  read  the  name  of  the  symptom 
and  point  to  the  appropriate  card  on  the  blackboard.  You 
should  enter  the  first  letter  of  the  symptom  in  the  column 
headed  SYMPTOM  on  your  answer  sheet.  You  should  then  make 
your  decision.  If  you  decide  that  the  patient  has  virus  0, 
mark  an  0  in  the  column  headed  CHOICE.  If  you  decide  that  the 
patient  has  virus  Y,  mark  a  Y  in  the  column  headed  CHOICE. 

You  will  be  given  fifteen  seconds  to  record  the  first  letter  of 
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the  symptom  and  to  make  and  record  your  choice.  Be  sure  that  you 
make  your  choice  within  this  time  limit.  We  will  have  a  few 
practice  trials  so  that  you  can  get  used  to  the  pacing. 

After  you  have  made  and  recorded  your  choice,  that  is,  after 
the  fifteen  seconds,  I  will  tell  you  which  strain  of  virus  the 
patient  had.  I  will  do  this  by  reading  the  word  on  the  3x5  card 
which  contained  the  symptom.  I  will  also  point  to  the  appropriate 
card  on  the  blackboard.  Record  this  letter  on  your  answer  sheet 
in  the  column  headed  VIRUS.  Five  seconds  after  I  have  done  this, 

I  will  proceed  with  the  next  trial. 

Please  do  not  try  to  see  what  choices  your  neighbors  are 
making,  and  do  not  indicate  by  expression  or  sound  whether  you  have 
made  the  correct  or  wrong  choice  on  any  trial.  Do  not  become  dis¬ 
couraged  if  you  are  wrong  in  some  cases.  It  is  impossible  to  be 
right  in  every  case.  1  Remember  that  it  is  important  to  be  cor¬ 
rect  as  often  as  you  can. 

Are  there  ar.y  questions  concerning  what  you  are  supposed  to 
do?  Be  sure  to  ask  me  now  if  you  do  not  understand  what  you  are 
to  do. 

We  will  now  proceed  with  the  practice  trials.  At  the  comple¬ 
tion  of  these  practice  trials  I  will  answer  any  further  questions 
which  you  may  have. 

Are  there  any  further  questions?  Be  sure  to  ask  any  question 
which  is  related  to  what  you  are  to  do  if  you  have  any  doubts, 

ADDITIONAL  INSTRUCTIONS  FOR  CP  GROUP 

This  figure  on  the  blackboard  will  help  you  in  making  your 
decisions.  Let  me  explain  the  meaning  of  this  figure.  Clinics 
throughout  the  country  have  kept  records  for  thousands  of  patients 
who  have  had  ;the  virus  in  which  we  are  interested.  These  records 
tell  which  strain  of  virus  each  patient  had  and  which  symptom  was 
reported  by  the  patient.  As  I  have  said  before,  it  is  possible 
to  tell  which  strain  of  virus  a  particular  patient  had  a  few  days 


after  treatment  has  been  administered.  Prom  all  of  these 
records,  the  records  of  a  thousand  patients  who  were  known  to 
have  virus  Y  were  selected  and  the  records  of  a  thousand  pa¬ 
tients  who  were  known  to  have  virus  0  were  selected.  This 
figure  on  the  blackboard  was  prepared  using  these  records. 

Now  consider  only  the  records  of  the  thousand  patients 
who  were  known  to  have  virus  0.  The  height  of  the  blue  rec¬ 
tangle  above  each  symptom  is  proportional  to  the  number  of 
patients  with  virus  0  who  reported  that  symptom.  For  instance, 
of  the  thousand  patients  who  had  virus  0  more  reported  FEVER 
than  any  other  symptom.  DROWSINESS  was  the  next  most  frequent 
symptom  reported  by  the  thousand  patients  who  had  virus  0. 
Finally  of  the  thousand  patients  who  had  virus  0  fewer  reported 
HEADACHE  than  any  other  symptom. 

Now  consider  only  the  records  of  the  thousand  patients 
who  were  known  to  have  virus  Y.  The  height  of  the  red  rec¬ 
tangle  above  each  symptom  is  proportional  to  the  number  of 
patients  with  virus  Y  who  reported  that  symptom.  For  instance, 
of  the  thousand  patients  who  had  virus  Y  more  reported  NAUSEA 
than  any  other  symptom,  SORE  THROAT  was  the  next  most  fre¬ 
quent  symptom  reported  by  the  thousand  patients  who  had  virus 
Y.  Finally  of  the  thousand  patients  who  had  virus  Y  fewer 
reported  BACKACHE  than  any  other  symptom. 

Although  this  figure  is  based  upon  the  records  of  a 
thousand  patients  who  were  known  to  have  virus  Y  and  a  thousand 
patients  who  were  known  to  have  virus  0,  it  does  not  neces¬ 
sarily  mean  that  it  was  as  easy  to  get  the  thousand  records 
for  the  one  virus  as  for  the  other,  easy  in  the  sense  that 
there  may  have  been  more  patients  who  were  found  to  have 
one  strain  of  virus  than  there  were  <to  have  the  other  strain. 
You  should  consider  the  overall  frequency  of  each  strain  of 
virus  in  making  your  decisions.  Although  a  particular  symp¬ 
tom  may  occur  more  frequently  when  one  strain  of  virus  is 
present  than  when  the  other  strain  is  present,  it  does  not 
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necessarily  follow  that  the  first  strain  of  virus  is  more  likely 
when  the  symptom  occurs.  So,  in  making  your  diagnoses  you  should 
consider  the  overall  frequency  of  each  strain  of  virus. 

You  will  get  an  idea  of  these  frequencies  by  paying  attention 
to  which  symptoms  occur  more  frequently.  For  instance,  if  FEVER, 
DROWSINESS  and  BACKACHE  tend  to  occur  quite  frequently,  it  would 
indicate  that  virus  0  is  occurring  more  frequently  than  is  virus 
Y.  On  the  other  hand,  if  NAUSEA,  SORE  THROAT  and  HEADACHE  tend 
to  occur  quite  frequently,  it  would  indicate  that  virus  Y  is 
occurring  more  frequently  than  is  virus  0,  Your  task  is  to  make 
a  choice  on  each  trial  and  to  try  to  be  right  as  often  as  you 
can.  At  the  end  of  the  experiment  I  will  tell  you  which  virus 
each  patient  had. 

These  cards  on  the  blackboard  name  the  symptoms  which  will 
be  reported.  At  the  beginning  of  each  trial  I  shall  announce  the 
trial  number.  I  will  then  pick  up  one  of  these  3x5  cards.  The 
name  of  the  symptom  reported  by  the  patient  is  written  on  the 
cards.  I  will  read  the  name  of  the  symptom  and  point  to  the 
appropriate  cafd  on  the  blackboard.  You  should  enter  the  first 
letter  of  the  symptom  in  the  column  headed  SYMPTOM  on  your  answer 
sheet.  You  should  then  make  your  decision.  If  you  decide  that 
the  patient  has  virus  0,  mark  an  0  in  the  column  headed  CHOICE. 

If  you  decide  that  the  patient  has  virus  Y,  mark  a  Y  in  the  column 
headed  CHOICE.  You  will  be  given  fifteen  seconds  to  record  the 
first  letter  of  the  symptom  and  to  make  and  record  your  choice. 

Be  sure  that  you  make  your  choice  within  this  time  limit.  We 
will  have  a  few  practice  trials  so  that  you  can  get  used  to  the 
pacing.  £  '  ■' i 

Remember  that  you  will  be  given  twenty  seconds  between  the 
initiation  of  successive  trials.  Please  do  not  try  to  see  what 
choices  your  neighbors  are  making.  Do  not  indicate  by  expression 
or  sound  how  you  think  you  are  doing.  It  is  impossible  to  be 
right  in  every  case.  Remember  that  it  is  important  to  be  correct 
as  often  as  you  can. 


-82- 


Are  there  any  questions  concerning  what  you  are  supposed 
to  do?  Be  sure  to  ask  me  now  if  you  do  not  understand  what 
you  are  to  do. 

We  will  now  proceed  with  the  practice  trials.  At  the 
completion  of  these  practice  trials  I  will  answer  any  further 
questions  which  you  may  have. 

Are  there  any  further  questions?  Be  sure  to  ask  any 
question  which  is  related  to  what  you  are  to  do  if  you  have 
any  doubts. 
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APPENDIX  III 

INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  ^OR  BLOCKS  OF  ^IVE  TRIALS 


TABLE  1 


INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  FOR  BLOCKS  OF  FIVE  TRIALS 

GROUP  CC-FF  (N  =  19) 


S  BLOCKS 


+ 


1-10 

11-20 

21-30 

2.4155  3.4773 

4.3958  4.3958 

5.2424  5.2424 

3.4773 

4.6780 

5.2424 

3.4773 

4.6780 

5.9500 

3.8313 

4.6780 

5.9500 

3.9725 

4.6780 

5.9500 

4.2547 

4.9602 

5.9500 

4.2547 

4.9602 

5.9500 

4.3958 

5.1013 

6.0911 

4.3958 

5.1013 

6.2322 

1-10 

11-20 

21-30 

1.4568 ‘  1.8129 
4.29S0  4.2990 

5.4998,*  5.8539 

1.8129 

4.5813 

5.8539 

1.8129 

4.5813 

5.8539 

2.1670 

4.5813 

5.8539 

2.8752 

4.5813 

5.8539 

2.8752 

4.8635 

5.8539 

3.2293 

4.8635 

5.8539 

3.7244 

5.0046 

5.8539 

3.7244 

5.0046 

5.9950 

1-10 

11-20 

21-30 

.8842 '  1.9459 
5.0S33  5.0233 

5.9*18  *  6.2959 

1.9459 

5.3055 

6.2959 

2.2999 

5.3055 

6.2959 

2.6541 

5.3055 

7.1801 

2.7952 

5.3055 

7.1801 

2.9363 

5.8007 

7.1802 

3.2903 

5.8007 

7.1801 

5.0233 

5.8007 

7.3212 

5.0233 

5.8007 

7.3212 

1-10 

11-20 

21-30 

.9^67*  1.6644 
3.2510  3.2910 

4. 4518*  4.8459 

* 

1.8055 

3.5733 

4.8459 

2.1595 

3.5733 

4.8459 

2.8678 

3.9274 

4.8459 

3.0089 

3.9274 

4.8459 

3 . 1500 
4.2096 
4.8459 

3.1500 

4.2096 

4.8459 

3.2910 

4.3507 

5.5616 

3.2910 

4.3567 

5.9849 

1-10 

11-20 

21-30 

.5746*  .5746* 

1.6342  1.6342 

2.4808*  2.4808 
• 

.7157 

1.9164 

2.4808 

.7157 

1.9164 

2.4808 

1.0698 

1.9164 

2.4808 

1.2109 

1.9164 

2.4808 

1.4931 

2.1986 

2.4808 

1.4931 

2.1986 

2.4868 

1.6342 

2.3397 

2.6219 

1.6342 

2.3397 

2.9041 

1-10 

11-20 

21-30 

.8842'  1.9459 
3.7850  3.7850 
4.6316*  4.6316 

1.9459- 

4.0672 

4.6316 

2.2999 

4.0672 

4.6316 

2.6541 

4.0672 

5.5158 

2.7952 

4.0672 

5.5158 

2.9363 

4.3494 

5.5158 

2.9363 

4.3494 

5.5158 

3.7850 

4.4905 

5.6569 

3.7850 

4.4905 

5.6569 

1-10 

11-20 

21-"0 

.9567'  2.0185 
4.2472  4.2472 
5.0938  5.4479 

2.0185 

4.5294 

5.4479 

2.0185 

4.5294 

5.4479 

2.7266 

4.5294 

5.4479 

2.8678 

4.5294 

5.4479 

3.7520 

4.8116 

5.4479 

3.7520 

4.8116 

5.4479 

4.2472 

4.9527 

5.5890 

4.2472 

4.9527 

5.7301 

TABLE  1 — (Continued) 


S  Blocks 


8 

1-10 

11-20 

21-30 

3.2997 

7.4840 

8.7560 

4.3615 

7.4840 

8.7560 

4*5026 

7.7662 

9.4642 

4.8566 

7.7662 

9.4642 

5.5649 

7.7662 

10.1718 

6.0600 

7.7662 

10.1718 

6.0600 

8.0484 

10.1718 

6.0600 

8.0484 

10.1718 

6.2012 

8.0484 

10.1718 

6.5553 

8.7560 

10.1718 

9 

1-10 

11-20 

21-30 

.8842 

4.4219 

5.2685 

1.9459 

4.4219 

5.2685 

2.0870 

4.7041 

5.2685 

2.4411 

4.7041 

5.2685 

3.1493 

4.7041 

5.2685 

3.6445 

4.7041 

5.2685 

3.9267 

4.9863 

5.2685 

4.2808 

4.9863 

\5.2685 

4.4219 

5.1274 

5.4096 

4.4219 

5.1274 

5.8329 

10 

1-10 

11-20 

21-30 

.9567 

4.7424 

5.5890 

2.0185 

4.7424 

5.5890 

2.9026 

5.0246 

5.5890 

2.9026 

5.0246 

5.5890 

3.2567 

5.0246 

5.5890 

3.7520 

5.0246 

5.5890 

3.8931 

5.3068 

5.5890 

4.2472 

5.3068 

5.5890 

4.7424 

5.4479 

5.7301 

4.7424 

5.4479 

5.8712 

11 

1-10 

11-20 

21-30 

.5746 

2.2013 

3.0479 

.5746 

2.2013 

3.0479 

.7157 

2.4835 

3.0479 

.7157 

2.4835 

3.0479 

1.4238 

2.4835 

3.0479 

1.5650 

2.4835 

3.0479 

1,7061 

2.7657 

3.0479 

2.0602 

2.7657 

3.0479 

2.2013 

2.9068 

3.1890 

2.2013 
2  9068 
3.6123 

12 

1-10 

11-20 

21-30 

.8842 

3.1136 

3.9602 

1.2383 

3.1136 

3.9602 

1.2383 

3.3958 

3.9602 

1.2383 

3.3958 

3.9602 

1.5924 

3.3958 

3.9602 

1.7334 

3.3958 

3.9602 

2.0157 

3.6780 

3.9602 

2.9725 

3.6780 

3.9602 

3.1136 

3.8191 

4.1013 

3.1136 

3.8191 

4.3835 

13 

1-10 

11-20 

21-30 

.9567 

3.0095 

4.9178 

.9567 

3.0095 

5.2719 

.9567 

3.2917 

5.2719 

.9567 

3.2917 

5.2719 

1.6649 

3.2917 

5.2719 

1.8061 

3.2917 

5.2719 

1.9471 

3.5739 

5.2719 

2.3013 

3.5739 

5.2719 

2.6554 

3.7150 

5.2719 

3.0095 

4.4226 

5.2719 

14 

1-10 

11-20 

21-30 

.8842 

1.8027 

2.6493 

.8842 

1.8027 

2.6493 

.8842 

2.0849 

2.6493 

1.2383 

2.0849 

2.6493 

1.2383 

2.0849 

2.6493 

1.3794 

2.0849 

2.6493 

1.6616 

2.3671 

2.6493 

1.6616 

2.3671 

2.6493 

1.8027 

2.5082 

2.7904 

1.8027 

2.5082 

3.2137 

15 

1-10 

11-20 

21-30 

1.4588 

4.0780 

4.9246 

2.5205 

4.0780 

4.9246 

2.5205 

4.3602 

4.9246 

2.8746 

4.3602 

4.9246 

3.2287 

4.3602 

4.9246 

3.2287 

4.3602 

4.9246 

3.3698 

4.6424 

4.9246 

3.7239 

4.6424 

4.9246 

4.0780 

4.7835 

5.0657 

4.0780 

4.7835 

5.4890 

TABLE  1 — (Continued) 


S  Blocks 


16 

1-10 

11-20 

21-30 

.8842 

3.431-5 

5.3398 

1.9459 

3.4315 

5.6939 

1.9459 

3.7137 

5.693^ 

2.2999 

3.7137 

5.6939 

2.6541 

4.0678 

5.6939 

2.7952 

4.0678 

5.6939 

2.9363 

4.3500 

5.6939 

3.2903 

4.3500 

5.6$39 

3.4315 

4.4911 

5.8350 

3.4315 

4.4911 

5.8350 

17 

1-10 

11-20 

21-30 

.5746 

2.0602 

2.9068 

.9287 

2.06Q2 

2.9068 

.9287 

2.3424 

2.9068 

.9287 

2.3424 

2.9068 

1.2828 

2.3424 

2.9068 

1.7780 

2.3424 

2.9068 

1.9191 

2.6246 

2.9068 

1.9191 

2.6246 

2.9068 

2.0602 

2.7657 

3.0*179 

»» 

2.0602 

2.7657 

3.4712 

18 

1-10 

11-20 

21-30 

• 

1.4588 

4.3602 

5.8452 

2.5205 

4.3602 

5.8452 

2.5265 

4.5013 

5.8452 

2.8746 

4.5013 

6.1993 

3.5828 

4.8554 

7.0835 

3.7239 

4.8554 

7.0835 

3.8649 

4.9965 

7.0835 

4.2191 

5.7041 

7.0835 

4.3602 

5.8452 

7.0835 

»> 

4.3602 

5.8452 

7.0835 

1 

19 

1-10 

11-20 

21-30 

.8842 

4.7573 

7.4607 

2.1225 

4.7573 

7.4607 

2.1225 

5.0395 

7.4607 

2.4766 

5.0395 

7.4607 

3.4052 

5.0395 

7.4607 

3.5464 

5.0395 

7.4607 

3.6875 

5.3217 

7.4607 

4.0416 

6.0293 

7.4607 

4.1827 

6.7450 

7.4607 

4.1827 

6.7450 

7.4607 

OO 

1 

TABLE  2 

INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  FOR  BLOCKS  OF  FIVE  TRIALS 

CP-CC-FF  (N  =  12) 


S  Blocks 


1-10 

11-20 

21-30 

.0000 

1.5575 

2.4041 

.3541 

1.5575 

2.4041 

.3541 

1.8396 

2.4041 

.7081 

1.8396 

2 . 4o4l 

1.4164 

1.8396 

2.4041 

1.4164 

1.8396 

2.4041 

1.4164 

2.1219 

2.4041 

1.4164 

2.1219 

2.4041 

1.5575 

2.2630 

2.4041 

1.5575 

2.2630 

2.4041 

1-3  0 
11-20 
21-30 

.0000 

3.8950 

4.2491 

.3541 

4.2491 

4.2491 

.3541 

4.2491 

4.6032 

1.0622 

4.2491 

4.6032 

1.7705 

4.2491 

4.6032 

2.4786 

4.2491 

4.6032 

2-4786 

4.2491 

4.6032 

2.8328 

4.2491 

5.4875 

3.1869 

4.2491 

5.4875 

3.5409 

4.2491 

5.4875 

1-10 

11-20 

21-30 

.0000 

3.5398 

6.3713 

.3541 

3.5398 

6.3713 

.3541 

4.2473 

6.3713 

1.0622 

4.6014 

6.7254 

1.4164 

4.9555 

6.7254 

2.1245 

5.6632 

6.7254 

2.1245 

5.6632 

6.7254 

2.8321 

5.6632 

7.0795 

3.5398 

5.6632 

7.0795 

3.5398 

6.0172 

7.0795 

1-10 

11-20 

21-30 

.8842 

7.7128 

11.3568 

2.8301 

7.7128 

11.7108 

3.7143 

7.8540 

11.7108 

4.4225 

7.8540 

11.7108 

6.0149 

7.8540 

11.7108 

6.3689 

7.8540 

11.7108 

6.5101 

8.7027 

11.7108 

6.8642 

8.7027 

12.0650 

7.7128 

9.0568 

12.0650 

7.7128 

11.0027 

12.0650 

1-10 

11-10 

21-30 

.0000 

2.0527 

2;8993 

.3541 

2.0527 

2.8993 

.3541 

2.3349 

2.8993 

1.0622 

2.3349 

2.8993 

1.7705 

2.3349 

2.8993 

1.7705 

2.3349 

2.8993 

1.9H5 

2.6171 

2.8993 

1.9115 

2.6171 

2.8993 

2.0527 

2.7582 

3.0404 

2.0527 

2.7582 

3.3226 

1-10 

11-20 

21-30 

.0000 

3.5040- 

4.7047 

1.2383 

3.8581 

4.7047 

1.2383 

4.1402 

4.7047 

1.2383 

4.1402 

4.7047 

1.9464 

4.1402 

4.7047 

2.7958 

4.1402 

4.7047 

2.7958 

4.4225 

4.7047 

3.1499 

4.4225 

4.7047 

3.5040 

4.5636 

4.7047 

3.5040 

4^5636 

4.7047 

1-10 

11-20 

21-30 

.0000 

2.9738 

4.1772 

.3541 

3.3279 

4.1772 

.3541 

3.3279 

4.5313 

1.0622 

3.3279 

4.5313 

1.7705 

3.6820 

4.5313 

2.4786 

3.6820 

4.8854 

2.4786 

3 . 6920 
4.8854 

2.8328 

3.6820 

4.8854 

2.9738 

3.8232 

4.8854 

2.9738 

3.8232 

4.8854 

TABLE  2— (Continued) 


S  Blocks 


8 

1-10 

11-20 

21-30 

.0000 

3.1869 

3.8924 

.3541 

3.1869 

3.8924 

.3541 

3.3279 

3.8924 

1.0622 

3.3279 

3.8924 

1.7705 

3.3279 

3.8924 

2.4786 

3.3279 

3.8924 

2.4786 

3.6102 

3.8924 

2.3328 

3.6102 

3.8924 

3.1869 

3.7513 

3.8924 

3.1869 

3.7513 

3.8924 

9 

1-10 

11-20 

21-30 

.0000 

.4952 

1.0596 

..3541 

.4952 

1.0596 

.3541 

.6362 

1.0596 

•3541 

.  6362 

1.0596 

.3541 

.6362 

1.7672 

.3541 

.6362 

1.7672 

.3541 

.7774 

1.7672 

.3541 

.7774 

2.1213 

.4952 

.9185 

2.2624 

.4952 

.9185 

2.4035 

10 

1-10 

11-20 

21-30 

* 

.0000 

3.8944 

4.6718 

1.0616 

3.8944 

5.3794 

1.0616 

4.1767 

5.7336 

1.7699 

4.1767 

5.7336 

2.4781 

4.5308 

5.7336 

3.1363 

4.5308 

5.7336 

3.1863 

4.6718 

5.7336 

3.5403 

4.6718 

5.7336 

3.5403 

4.6718 

5.7336 

3.5403 

4.6718 

6.0158 

11 

1-10 

11-20 

21-30 

.0000 

3.8950 

4.8854 

.3541 

4.2491 

5.2396 

.3541 

4.6032 

5.9477 

1.0622 

4.6032 

5.9477 

1.7705 

4.6032 

5.9477 

2.4786 

4.6032 

5.9477 

2.4786 

4.6032 

5.9477 

2.8328 

4.6032 

5.9477 

3.1869 

4.7443 

6.0888 

3.5409 

4.7443 

6.3711 

12 

1-10 

11-20 

21-30 

.0000 

3.8950 

4.8136 

.3541 

4.2491 

4.8136 

.3541 

4.2491 

4.8136 

1.0622 

4.2491 

4.8136 

1.7705 

4.2491 

4.8136 

2.4786 

4.2491 

4.8136 

2.4786 

4.5313 

4.8136 

2.8328 

4.5313 

4.8136 

3.1869 

4.6724 

4.9547 

3.5409 

4.6724 

5.3780 

TABLE  3 


INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  FOR  BLOCKS  OF  FIVE  TRIALS 

GROUP  CC-FI  (N  =  10) 


S  Blocks 


1-10 

11-20 

21-30 

.8842 

3.4308 

4.6316 

1.5918 

3.4308 

4.6316 

1.5918 

3.7131 

4.9857 

2.6534 

3.7131 

4.9857 

3.0076 

3.7131 

5.8699 

3.1487 

3.7131 

5.8699 

3.2898 

3.9953 

5.8699 

3.2898 

3.9953 

7.6383 

3.4308 

4.1364 

7.7794 

3.4308 

4.1364 

8.0616 

1-10 

11-20 

21-30 

1.8410 

4.3882 

5.,2349 

2.9026 

4.3882 

5.2349 

2.9026 

4.6705 

5.5890 

3.2567 

4.6705 

5.5890 

3.6108 

4.6705 

5.5890 

4.1061 

4.6705 

5.5890 

4.2472 

4.9527 

5.5890 

4.2472 

4.9527 

8.2416 

4.3882 

5.0938 

8.3827 

4.3882 

5.0938 

8.8060 

1-10 

11-20 

21-30 

1.8410 
5. .096  5 
6.6513 

2.9026 

5.0965 

7.0054 

2.9026 

5.3787 

7.3595 

3.2567 

5.3787 

7.3595 

3.6108 

5.7328 

9-1279 

4.4601 

5.7328 

9.4820 

4.6013 

6.0150 

9.4820 

4.9554 

6.0150 

9.8361 

5.0965 

6.1561 

9.8361 

5.0965 

6.1561 

9.9772 

1-10 

11-20 

21-30 

.9567 
4.3534 
5.  .8465 

I.3109 

4.3534 

6.9082 

1.4520 

4.6356 

6.9082 

2.1601 

4.6356 

6.9082 

2.5143 

4.9897 

7.7924 

3.0095 

4.9897 

8.1465 

3.1505 

5.1308 

8.1465 

3.5047 

5.1308 

8.5006 

4.3534 

5.2719 

9.0752 

4.3534 

5.2717 

9.0752 

1-10 

11-20 

21-30 

1.7684 
5-2724 
7. .4019 

2.8301 
5. .2724 
7-7560 

2.8301 

5.5547 

7.7560 

3.1842 

5.5547 

7.7560 

3.5383 

5.5547 

7.7560 

3.6794 

5.5547 

7.7560 

3.8205 

5.8369 

7.7560 

4.1745 

5.8369 

7.7560 

4.3157 

5.9780 

9.1793 

4.3157 

6.3321 

9.3204 

1-10 

11-20 

21-30 

1.’4588 

4-5732 

6.3485 

2.5205 

4.5732 

6.7026 

2.5205 

4.8554 

7.4108 

2.8746 

4.8554 

7.4108 

3.5828 

4.8554 

7.4108 

4.0780 

4.8554 

7.7649 

4.0780 

5.1376 

7.7649 

4.4321 

5.1376 

7.7649 

4.5732 

5.2787 

8.4806 

4.5732 

5.2787 

8.7628 

1-10 

11-20 

21-30 

.9567 

4.7101 

6.1232 

1.3109 

4.7101 

7.5384 

1.3109 

4.8512 

7.5384 

1.3109 

4.8512 

7.8925 

1.6649 

4.8512 

9.3077 

1.8061 

4.8512 

10.0153 

1.9471 

5.1334 

10.0153 

2.3013 

5.1334 

10.8995 

3.7533 

5.2745 

11.7482 

4.7101 

5.2745 

12.8791 

Table  3 — (Continued) 


S  Blocks 


a 

1-10 

1.8410 

2.5486 

2.5486 

2.9026 

3.6108 

4.1061 

4.3882 

4.3882 

4.5294 

4.5294 

11-20 

4.8835 

4.8835 

5.1657 

5.1657 

5.1657 

5.1657 

5.4479 

5.4479 

5.9431 

5.9431 

21-30 

6.4383 

7.8535 

8.9158 

8.9158 

9.8000 

11.3918 

11.7459 

11.7459 

12.4616 

12.7438 

9 

1-10 

.5746 

.5746 

.7157 

1.4238 

1.7780 

1.9191 

1.9191 

2.8759 

3.7246 

3.7246 

11-20 

4.2991 

4.2991 

4.5814 

4.5814 

4.5814 

4.5814 

4.8636 

4.8636 

5.5793 

5.5793 

21-30 

5.7204 

6.4280 

7.3122 

8.2690 

10.0374 

10.0374 

10.0374 

10.0374 

10.7531 

11.0353 

10 

1-10 

1.7684 

2.8301 

2.9711 

3.8554 

4.2095 

4.3506 

4.4917 

4.4917 

4.6328 

4.6328 

11-20 

4.6328 

4.6328 

4.9150 

4.9150 

4.9150 

4.9150 

5.1972 

5.1972 

5.3383 

5.3383 

21-30 

5.4794 

5.8335 

6.1876 

6.1876 

7.0718 

7.0718 

7.0718 

7.0718 

7.2129 

7.3540 

TABLE  4 


INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  ^OR  BLOCKS  OF  PIVF.  TRIALS 

GROUP  CP-CC-FI  (M  =  12) 


s 

Blocks 

1 

1-10 

.8842 

1.9459 

1.9459 

3.1842 

3.5383 

4.0335 

4.0335 

4.3876 

4.8828 

5.2369 

11-29 

5.5909 

5.5909 

5.8732 

5.8732 

5.8732 

5.8732 

6.0143 

6.7219 

6.8630 

7.2171 

21-30 

7.9247 

8.2788 

8.9870 

8.9870 

8.9870 

9.3411 

9.3411 

9.3411 

9.3411 

9.3411 

2 

1-10 

,8843 

2.1225 

2.8301 

3.5383 

4.2464 

4.9547 

5.6623 

6.7239 

7.0781 

7.4321 

11-20 

7.7862 

8.1403 

8.2815 

8.2815 

8.2815 

8.2815 

8.9177 

8.9177 

8.9177 

9.2719 

21-30 

9.6260 

9.9800 

10.3341 

10.3341 

11.2183 

11.2183 

11.2183 

12.1025 

12.1025 

12.1025 

3 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.1245 

2.1245 

2.4786 

2.4786 

2.4786 

11-20 

2.4786 

2.4786 

2.6198 

2.6198 

2.6198 

2.6198 

2.6198 

2.6198 

2.6198 

2.6198 

21-30 

3.1150 

3.4690 

4.1772 

4.1772 

4.1772 

4.5313 

4.5313 

4.8854 

4.8854 

4.8854 

4 

1-10 

.0000 

1.2383 

1.2383 

1.9464 

2.6547 

3.0087 

3.0087 

3.3628 

3.7170 

4.0710 

11-20 

4.4251 

4.4251 

4.5662 

4.5662 

4.5662 

4.5662 

4.8485 

4.8485 

5.3436 

5.3436 

21-30 

5.4848 

5.4848 

6.5470 

6.5470 

6.5470 

6.5470 

6.9012 

6.9012 

7.0423 

7.4656 

5 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.4786 

2.4786 

2.8328 

3.3279 

3.6820 

11-20 

4.0362 

4.0362 

4.3184 

4.3184 

4.6724 

4.6724 

4.8136 

4.8136 

5.5218 

5.5218 

21-30 

5.5218 

5.8758 

6.9381 

7.2922 

7.2922 

7.6464 

7.6464 

8.3545 

8.4956 

8.4956 

6 

1-10 

.0000 

.3541 

1.2383 

1.9464 

2.3006 

2.6547 

2.7958 

3.1499 

3.8575 

4.7417 

11-20 

5.0958 

5.0958 

5.2369 

5.2369 

5.2369 

5.2369 

6.2267 

6.2267 

6.2267 

6.2267 

21-30 

6.9343 

6.9343 

6.9343 

7.2884 

7.2884 

7.2884 

7.2884 

8.5267 

9.2343 

10.7906 

7 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.4164 

1.4164 

1.5575 

1.9115 

3.2910 

3.2910 

11-20 

3.2910 

3.2910 

3.4321 

3.4321 

3.4321 

3.4321 

3.5732 

3.5732 

3.5732 

3.5732 

21-30 

3.5732 

3.9273 

3.9273 

3.9273 

5.6956 

6.5799 

7.4641 

9.2325 

9.2325 

9.2325 

TABLE  4 — (Continued) 


S  Blocks 


8 

1-10 

11-20 

21-30 

.0000 

2.6198 

4.9622 

.3541 

2.9738 

5.3163 

.3541 

3.2560 

5.6704 

.3541 

3.2560 

5.6704 

.7081 

3.2560 

5.6704 

1.2034 

3.2560 

6.6272 

1.2034 

3.5383 

6.6272 

1.5575 

3.5383 

6.6272 

1.9115 

4.0335 

7.7251 

2.2656 

4.0335 

8.0073 

9 

1-10 

11-20 

21-30 

.0000 

3.1869 

5.0972 

.3541 

3.1869 

5.8048 

.3541 

3.3279 

6.5131 

1.0622 

3.3279 

6.5131 

1.7705 

3.3279 

6.5131 

2.4786 

3.3279 

7.2206 

2.4786 

4.0355 

7.9288 

2.8328 

4.7432 

9.6972 

3.1869 

4.7432 

9.6972 

3.1869 

5.0972 

9.6972 

10 

1-10 

11-20 

21-30 

.0000 

3.5409 

4.7417 

.3541 

3.5409 

5.0958 

.3541 

3.8232 

5.4498 

1.0622 

3.8232 

5.4498 

1.7705 

3.8232 

6.3341 

2.4736 

3.8232 

6.3341 

2.4786 

4.1054 

6.3341 

2.8328 

4.1054 

6.3341 

3.1869 

4.2464 

6.4752 

3.5409 

4.2464 

6.7574 

11 

1-10 

11-20 

21-30 

.8842 

4.8828 

6.8624 

2.8301 

4.8828 

7.5700 

2.8301 

5.0239 

8.2782 

3.5383 

5.0239 

8.6322 

4.2464 

5.0239 

9.3399 

4.6005 

5.0239 

9.3399 

4.7417 

5.1650 

9.6940 

4.7417 

5.8726 

9.6940 

4.8828 

6.0137 

9.6940 

4.8828 

6.0137 

9.8351 

12 

1-10 

11-20 

21-30 

.0000 

3.3279 

4.4589 

.3541 

3.3279 

4.4589 

■ .3541 
3.3279 
5.8747 

1.0622 

3.3279 

6.9363 

1.7705 

3.3279 

8.3515 

2.1245 

3.3279 

9.0591 

2.2656 

3.4690 

9.0591 

2.2656 

4.1767 

9.0591 

2.6198 

4.3178 

9.9079 

2.9738 

4.3178 

11.0388 

*- 


* 


>  f 


TABLE  5 


y 


v 


INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  FOR  BLOCKS  OF  FIVE  TRIALS 

GROUP  CC-II  (N  =  19) 


S  Blocks 


1 

1-10 

1.8410 

2.9026 

2.9026 

4.1410 

4.4950 

4.6362 

6.5102 

7.8210 

7.9622 

7.9622 

11-20 

7.9622 

7.9622 

8.2444 

9.2012 

9.2012 

10.0854 

IO.3676  11.0752 

11.0752 

11.  0752 

21-30 

11.6498 

13.6396 

13.9937 

15.0554 

16.8238 

18.6648 

19.3730 

20.6113 

22.0701 

22.0701 

2 

1-10 

1.7684 

3.3602 

3.5013 

4.3855 

4.3855 

4.3855 

5.5519 

7.5704 

8.5957 

8.5957 

11-20 

8.5957 

9.3033 

9.5855 

9.5855 

9.5855 

9.5855 

9.8677 

10.5753 

11.5040 

12.5657 

21-30 

13.4144 

13.7685 

14.4761 

14.4761 

16.0679 

16.9521 

18.1904 

19.0746 

19.6492 

20.4979 

3 

1-10 

3.6093 

5.5553 

5.5553 

5.5553 

5.5553 

6.4039 

6.5451 

8.2095 

8.3504 

8.3506 

11-20 

8.9252 

8.9252 

9.2074 

9.2074 

9.2074 

10.7992 

11.0814 

11.0814 

11-7971 

11.7971 

21-30 

12.5128 

12.8669 

12.8669 

12.8669 

12.8669 

16.7264 

20.0872 

23.0939 

23.8096 

23.9507 

4 

1-10 

.0000 

1.0616 

1.0616 

1.0616 

1.4157 

1.5569 

1.5569 

1.5569 

2.6185 

2.9726 

11-20 

3.9014 

3.9014 

4.1836 

4.1836 

4.5377 

4.5377 

5.1740 

5.8816 

6.0227 

6.7303 

21-30 

7.4460 

7.4460 

7.4460 

7.4460 

9.2144 

9.2144 

9.5685 

9 . 5685 

9.5685 

9.7096 

5 

1-10 

1.7684 

2.8301 

2.8301 

2.8301 

4.0683 

4.5636 

4.7047 

5.0588 

5.0588 

5.0588 

11-20 

5.0588 

5.0588 

5.1999 

5.1999 

5.1999 

5.1999 

5.4821 

6.1897 

6.5438 

7.2514 

21-30 

8.8513 

8.8513 

9.2054 

9.2054 

10.0896 

10.4437 

10.4437 

11.6820 

12.2566 

12.5388 

6 

1-10 

.9567 

2.0185 

2.0185 

2.3726 

2.7266 

3.0808 

3.2219 

4.5328 

4.6738 

5.6307 

11-20 

6.5593 

6.9134 

7.0546 

7.4086 

8.3655 

8.3655 

8 . 8606 

8 . 8606 

9.2147 

9.2147 

21-30 

9.9305 

10.8592 

11.2133 

11.2133 

11.9208 

13.2317 

13.2317 

13.2317 

13.9475 

14.0886 

7 

1-10 

.9567 

2.0185 

2.0185 

3.2567 

3.6108 

4.1061 

4.2472 

4.2472 

4.2472 

4.6013 

11-20 

4.6013 

4.9554 

5.2375 

5.5916 

5.5916 

5.5916 

6.4404 

7.8556 

7.9967 

9.4119 

21-30 

9.9071 

10.8358 

12.0741 

13.1358 

14.0200 

15.2583 

16.1425 

16.4966 

16.4966 

16.6377 

TABLE  5 — (Continued) 


•% 


S  Blocks 


8 

1-10 

1.4588 

2.5205 

2.6615 

3.0157 

3.3698 

3.5108 

3.5108 

3.8649 

5.0678 

5.0678 

11-20 

5.6424 

6.3499 

6.6322 

6.6322 

6.9863 

6.9863 

8.3302 

8.3302 

8.4713 

8.8254 

21-30 

9.8952 

10.2493 

10.2493 

10.2493 

11.1335 

11.1335 

11.1335 

11.4876 

12.0622 

12.2033 

9 

1-10 

1.4588 

2.1664 

2.1664 

2.5205 

3.2287 

4.0774 

4.2185 

4.5726 

5.7754 

5.7754 

11-20 

5.7754 

5.7754 

6.0576 

6.0576 

6.4117 

6.4117 

7.H92 

8.5345 

9.2502 

9.6043 

21-30 

10.5330 

11.5947 

11.5947 

11.5947 

13.3631 

13.7171 

13.7171 

14.0713 

14.7789 

14.9200 

10 

1-10 

.8842 

1.9459 

1.9459 

2.2999 

2.2641 

2.7952 

2.9363 

3.8931 

3.8931 

3.8931 

11-20 

5.0423 

5.0423 

5.1834 

5.5375 

5.5375 

5.5375 

5.8197 

5.8197 

6.8895 

7.5971 

21-30 

8.3128 

8.8874 

9.2415 

9.2415 

10.1257 

10.1257 

10.1257 

10.1257 

10.8414 

10.9825 

11 

1-10 

2.7251 

3.7869 

3.9280 

5.8739 

7.8643 

8.5719 

8.5719 

9.8828 

11.6156 

11.6156 

11-20 

13.1471 

13.5011 

13.7834 

13.7834 

14.1375 

15.0217 

16.4736 

17.1812 

17.6765 

17.6765 

21-30 

19.4539 

20.5156 

20.8697 

23.5958 

25.3642 

26.3210 

27.2052 

28.7926 

28.9386 

30.4950 

12 

1-10 

.9567 

2.0185 

2.0185 

3.2567 

5.5568 

5.9108 

8.3868 

8.3868 

9.5896 

12.5963 

11-20 

15.0120 

15.3660 

15.5072 

15.5072 

17.6297 

18.5139 

20.4605 

20.4605 

21.1762 

21.1762 

21-30 

22.9091 

24.6784 

25.5626 

25.5626 

25.5626 

25.5626 

26.4468 

26.4468 

26.5879 

26.8701 

13 

1-10 

1.5313 

'2.5931 

2.5931 

2.9471 

3.3012 

3.7964 

4.8218 

5.1758 

6.2376 

6.2376 

11-20 

8.1230 

8.8306 

9.1129 

9.1129 

9.4670 

9.4670 

10.4568 

10.4568 

10.5979 

11.3055 

21-30 

11.4466 

11.4466 

11.4466 

12.7574 

14.1727 

14.1727 

14.1727 

14.1727 

15.0214 

15.3036 

14 

1-10 

2.4155 

3.4773 

3.4773 

3.8313 

4.5396 

5i3888 

5.3888 

5.3888 

6.5916 

6.9457 

11-20 

7.2999 

7.2999 

7.4410 

7.4410 

7.4410 

8.1485 

8.4308 

9.1384 

9.6336 

9.6336 

21-30 

9.7747 

10.3493 

10.7034 

10.7034 

11.4110 

11.4110 

11.7651 

12.1192 

12.1192 

13.1089 

15 

1-10 

2.4155 

3.4773 

3.4773 

4.3615 

4.7156 

4.8566 

4.9978 

5.9545 

6.8033 

6,8033 

11-20 

7.3779 

7.3779 

7.6601 

7 .6601 

7.6601 

7.6601 

7.9423 

7.9423 

8.7916 

10.5609 

21-30 

10.7020 

12.1172 

14.0631 

17.3193 

19.7953 

20.5029 

22.0953 

22.9795 

25.6692 

26.6590 

i 

LPv 

C\ 

I 


TABLE  5 — (Continued) 


S  Blocks 

*  •  \  • 


16 

1-10 

1,4588 

2.5205 

2.5205 

2.8746 

3.2287 

3.2287 

4.2540 

5.3157 

6.5540 

6.5540 

11-20 

6.5540 

7.2616 

7.5438 

7.5438 

7.5438 

8.2514 

8.5336 

8.5336 

8.6747 

8.6747 

21-30 

9.8775 

10.2316 

10.5857 

12.9577 

14.3729 

16.9941 

16.9941 

16.9941 

18.0920 

19.2229 

17 

1-10 

.8842 

1.2383 

1.2383 

1.5924 

1.9464 

2.0876 

2.2287 

2.2287 

2.3698 

2.3698 

11-20 

2.3698 

2.3698 

2.8650 

3.5726 

3.5726 

3.5726 

4. 2089 

4.9165 

5.4117 

5.7658 

21-30 

6.4815 

6.4815 

6.8356 

6.8356 

7.5432 

8.4274 

8.4274 

8.4274 

9.4527 

9.5938 

18 

1-10 

.5746 

.9287 

I.O698 

1.7774 

1.7774 

2.2726 

3.1212 

4.8906 

5.9159 

6.8001 

11-20 

7.1542 

7.1542 

7.4364 

8.1440 

8.1440 

8.1440 

8.4262 

8.4262 

9.1419 

9.1419 

21-30 

9.8576 

10.4322 

10.4322 

11.1398 

11.1398 

12.0240 

12.0240 

12.7322 

12.7322 

13.7220 

19 

1-10 

1.4588 

2.1664 

2.1664 

2.5205 

2.8746 

3.0157 

4.1821 

4.8897 

4.8897 

4.8897 

11-20 

5.4643 

5.4643 

5.7465 

6.7033 

7.6601 

7.6601 

7.9423 

7.9423 

8.5169 

9.2245 

21-30 

9.7991 

10.7278 

10.7278 

12.7463 

13.4539 

14.4107 

14.4107 

15.2949 

16.8263 

16.9674 

TABLE  6 

INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  FOR  BLOCKS  OF  FIVE  TRIALS 

GROUP  CP-CC-II  (N  =  23) 


S  Blocks 


1 

1-10 

1.7684 

2.8301 

2.8301 

3.5383 

4.2464 

4.3876 

4.3876 

4.7417 

4.8828 

5.7670 

11-20 

7.6080 

7.6080 

7.8902 

8.5978 

9.4820 

9.4820 

9.7642 

9.7642 

9.7642 

10.4718 

21-30 

11.1794 

12.4616 

14.0540 

14.7616 

14.7616 

14.7616 

15.6458 

16.5300 

17.4142 

17.5553 

2 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.6198 

2.9020 

3.2560 

3.3972 

3.7513 

11-20 

4.6799 

5.0340 

5.5293 

5.8833 

5.8833 

5.8833 

6.0245 

6.0245 

7.4484 

7.4484 

21-30 

8.3770 

8.9516 

10.0139 

10.3680 

11.0757 

11.0757 

12.3140 

15.3207 

16.2049 

16.6282 

3 

1-10 

.0000 

.3541 

1.2383 

1.9464 

2.6547 

3.3628 

3.3628 

3.7170 

4.0710 

4.4251 

11-20 

4.7792 

5.1334 

5.4875 

5.8415 

6.1956 

6.1956 

6.5497 

6.5497 

7.2579 

7.6120 

21-30 

7.9661 

8.3202 

9.3825 

9.7366 

9.7366 

10.0907 

10.7989 

11.5071 

11.5071 

11.5071 

4 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.4786 

2.4786 

2.8328 

3.1869 

3.5409 

11-20 

3.8950 

4.2491 

4.6032 

4.9573 

5.3114 

6.1956 

6.5497 

6.5497 

6.9038 

7.9655 

21-30 

8.3197 

9.0272 

10.4430 

10.7971 

11.5047 

11.8588 

12.5670 

14.1594 

14.1594 

14.1594 

5 

1-10 

.0000 

.3541 

.3541 

.3541 

1.0622 

1.7705 

1.7705 

2.1245 

2.4786 

2.8328 

11-20 

3.1869 

3.5409 

3.6820 

3.6820 

3.6820 

3.6820 

3.8232 

5.2384 

5.7336 

7.1487 

21-30 

7.6440 

7.9981 

8.7062 

8.7062 

8.7062 

9.7679 

10.1220 

10.8303 

10.9713 

10.0713 

6 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.4786 

2.4786 

2.8328 

3.3279 

3.3279 

11-20 

3.6820 

3.6820 

3.9643 

3.9643 

4.3184 

4.3184 

5.5212 

5.5212 

6.3705 

7.0781 

21-30 

7.4321 

9.2015 

10.9713 

10.9713 

10.9713 

10.9713 

11.3254 

12.9179 

13.4924 

13.6336 

7 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.4786 

2.4786 

2.8328 

3.1869 

3.5409 

11-20 

3.8950 

4.2491 

4.6032 

4.9573 

5.3114 

5.3114 

7.4710 

9.5938 

9.7349 

10.0890 

21-30 

10.0890 

10.4431 

11.5054 

11.8595 

11.8595 

12.2136 

12.9218 

12.9218 

12.9218 

12.9218 

TABLE  6 — (Continued) 


S  Blocks 


16 

1-10 

.0000 

1.9459 

1.9459 

2.6541 

3.7158 

5.8391 

6.5467 

7.6084 

7.6084 

8.8467 

11-20 

10.0850 

10.0850 

10.5802 

11.2878 

12.5987 

13.4829 

13.7652 

13.7652 

14.6145 

16.0297 

21-30 

16.9583 

17.5329 

18.5952 

18.9493 

19.6569 

20.0111 

20.7192 

22.3117 

22.3117 

22.4527 

17 

1-10 

.0000 

1.2383 

1.2383 

1.5924 

2.3006 

3.0087 

3.0087 

3.3628 

3.7170 

4.0710 

11-20 

4.4251 

5.1327 

5.1327 

5.1327 

5.1327 

5.1327 

5.8403 

7.2555 

7.9638 

9.2021 

21-30 

9.5561 

9.9102 

10.2643 

10.6184 

10.6184 

10.9725 

11.6807 

12.3889 

12.3889 

12.3889 

18 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.1245 

2.1245 

2.1245 

2.4786 

2.8328 

11-20 

2.8328 

2.8328 

2.9738 

2.9738 

3.3279 

3.3279 

4.3897 

5.8048 

5.9459 

7.3612 

21-30 

7.8563 

8.9181 

9.9803 

9.9803 

9.9803 

10.3344 

10.6885 

10.6885 

10.6885 

10.6885 

19 

1-10 

.0000 

1.0616 

1.9459 

2.6541 

3.3622 

4.0705 

4.0705 

4.4246 

5.4862 

5.4862 

11-20 

5.8403 

6.1944 

6.5485 

6.9026 

7.2568 

7.2568 

7.6108 

7.6108 

8.3190 

8.6731 

21-30 

9.0272 

9.3813 

10.4436 

10.7977 

10.7977 

10.7977 

11.5059 

12.2141 

12.2141 

12.2141 

20 

1-10 

,0000 

1.9459 

2.8301 

5.8376 

6.5459 

7.6076 

7.6076 

7.6076 

7.7486 

7.7486 

11-20 

8  .3232 

8.3232 

8.6055 

8.6055 

8.6055 

8.6055 

9.1006 

9.1006 

9.8164 

9.8164 

21-30 

9.8l64 

9.8164 

10.1705 

10.5246 

10.5246 

10.5246 

10.5246 

11.2328 

11.9485 

12.3718 

21 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.4786 

2.4786 

2.8328 

3.1869 

3.5409 

11-20 

3.5409 

4.6026 

5.3102 

7.3287 

7.6828 

8.3904 

8.7445 

9.4521 

10.1603 

11.2220 

21-30 

11.5761 

12.2837 

13.3460 

13.7001 

13.7001 

13.7001 

14.0542 

14.7624 

14.7624 

14.7624 

22 

1-10 

.0000 

.3541 

1.0616 

1.7699 

2.4781 

3.1863 

3.1863 

3.5903 

3.8944 

5.2053 

11-20 

5.5594 

6.6211 

7.6828 

8.0369 

8.3910 

9.0986 

9.4527 

9.4527 

9.8068 

10.8685 

21-30 

10.8685 

11.9302 

12.9925 

13.3466 

16.7068 

17.0609 

17.7691 

19.3615 

19.3615 

19.5026 

23 

1-10 

,0000 

.3541 

.3541 

1.0622 

1.7705 

2.1245 

2.1245 

2.4786 

2.4786 

2.8328 

11-20 

3.1869 

3.5409 

3.8950 

3.8950 

4.2491 

4.2491 

5.4519 

5.4519 

6.1601 

7.2218 

21-30 

8.2835 

8.9911 

10.0534 

11.1151 

12.5303 

12.8844 

13.2385 

14.8309 

14.8309 

15.1131 

OO 

CT\ 


TABLE  6 — ( Continued )  - 


S  Blocks 


8 

1-10 

1.7684 

3.7143 

3.7143 

4.4225 

5.1307 

5.8389 

5.8389 

6.1930 

6.5470 

6.9011 

11-20 

7.2553 

7.6093 

7.9634 

8.3175 

8.6717 

8.6717 

9.0258 

9.0258 

9.7339 

10.0880 

21-30 

10.4421 

10.7962 

11.8585 

12.2126 

12.2126 

12.5667 

13.2749 

13.9831 

13.9831 

13.9831 

9 

1-10 

.0000 

.3541 

.3541 

1.0622 

2.4781 

3.8938 

3.8938 

4.2479 

4.6020 

4.9562 

11-20 

4.9562 

5.3102 

5.3102 

5.6643 

6.0184 

6.0184 

6.0184 

6.7260 

7.3007 

7.3007 

21-30 

8.0082 

8.0082 

9.0705 

9.4246 

10.3088 

10.3088 

10.6629 

11.3711 

11.3711 

11.3711 

10 

1-10 

.0000 

.3541 

1.2383 

1.5924 

3.0081 

3.7163 

3.9986 

4.7062 

4.8473 

4.8473 

11-20 

4.8473 

4.8473 

5.1295 

5.4836 

6.4404 

7.1480 

7.2890 

7.9967 

8.9254 

9.2795 

21-30 

9.2795 

10.5617 

10.5617 

11.8000 

12.6842 

13.3918 

13.7459 

14.1000 

15.0568 

15.1978 

11 

1-10 

.0000 

2.4769 

3.1844 

3.8926 

5.3084 

5.6625 

5.6625 

6.0167 

6.7242 

7.6084 

11-20 

7.9625 

8.3165 

8.8118 

8.8118 

8.8118 

9.5194 

10.0147 

11.4298 

11.7839 

12.1381 

21-30 

12.4921 

13.5538 

13.9079 

14.2620 

14.2620 

14.6161 

15.3243 

16.9167 

16.9167 

18.3319 

12 

1-10 

.0000 

.3541 

.3541 

.7081 

1.4164 

1.7705 

1.7705 

1.7705 

2.1245 

2.4786 

11-20 

2.8328 

2.8328 

3.1150 

3.1150 

3.1150 

3.1150 

3.2560 

3.2560 

4.3259 

5.2101 

21-30 

5.2101 

5.5642 

6.6265 

6.9805 

6.9805 

6.9805 

7.3346 

8.2188 

8.7935 

9^2168 

13 

1-10 

.0000 

I.O616 

4.2453 

5.8376 

6.5459 

8.6693 

9.5535 

9.9076 

11.1459 

11.4999 

11-20 

11.8541 

12.2082 

12.7033 

12.7033 

12.7033. 

12.7033 

12.9856 

12.9856 

13.7013 

13.7013 

21-30 

14.0553 

14.9841 

15.3382 

15.3382 

15.3382 

15.6923 

15.6923 

16.0463 

16.1875 

16.1875 

14 

1-10 

.0000 

1.2383 

2.1225 

2.8306 

3.5389 

3.8930 

3.8930 

3.8930 

4.2470 

4.6012 

11-20 

4.9552 

4.9552 

5.0964 

5.0964 

5.4504 

5.4504 

6.6533 

8.0685 

8.9177 

9.9795 

21-30 

10.3336 

12.1029 

13.1645 

13.1645 

13.8721 

14.9338 

15.6421 

16.3502 

16.3502 

16.3502 

15 

1-10 

.0000 

1.9459 

2.8301 

3.5383 

4.9540 

6.0158 

6.8644 

7.2186 

7.2186 

7.5727 

11-20 

8.5014 

9.7396 

10.0938 

10.4479 

11.6861 

11.6861 

12.0402 

12.7479 

13.1010 

13.4560 

21-30 

13.8101 

14.8718 

16.6417 

16.9958 

17.8800 

18.2341 

19.8265 

20.1806 

20.8882 

20.8882 

T/^LF  7 


INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  ^OR  BLOCKS  OF  FIVE  TRIALS 

GROUP  CP-CC  NOH-FIC-URE  (N  =  25) 


S  BLOCKS 


1 

1-10 

.0000 

1.9459 

2.6534 

4.0693 

4.7775 

5.8391 

6.8644 

7.9262 

8.2802 

9.5185 

11-20 

9.5185 

9.8727 

10.2267 

12.5261 

13.8370 

14.7212 

15.2164 

16 .6316 

16.9858 

18.7550 

21-30 

19.1092 

20.1708 

21.5866 

21.5866 

23.1784 

24.2401 

25.4784 

27.0708 

27.0708 

27.2119 

2 

1-10 

.0000 

I.7692 

1.7692 

2.8310 

4.2468 

5.3084 

5.4495 

5.8037 

5.8037 

6.6879 

11-20 

8.8830 

9.2370 

11.1829 

11.1829 

11.1829 

11.1829 

12.8473 

13.5549 

14.0501 

17.4112 

21-30 

19.3572 

19.3572 

20.4188 

21.1264 

21.1264 

21.1264 

22.7188 

23.9571 

24.0982 

24.8058 

3 

1-10 

.0000 

.3541 

.3541 

.7081 

1.7699 

2.1240 

2.1240 

2.4781 

2.4781 

2.8321 

11-20 

3.1863 

3.5403 

3.8944 

4.2485 

4.6026 

4.6026 

4.9567 

4.9567 

5.8060 

6.8677 

21-30 

7.2218 

8.9911 

10.0534 

10.4075 

10.4075 

10.4075 

10.7616 

10.7616 

10.9027 

12.3179 

4 

1-10 

.0000 

1.9459 

1.9459 

3.0076 

5.3075 

6.0158 

6.7233 

7.0774 

8.5295 

8.8835 

11-20 

9.2376 

10.4759 

11.5376 

12.5993 

13.8377 

14.5452 

14.8993 

15.6069 

16.3151 

17.0227 

21-30 

17.3768 

17.7309 

18.7932 

19.1473 

19.1473 

19.5014 

20.2096 

20.9178 

20.9178 

20.9178 

5 

1-10 

,0000 

.3541 

.3541 

1.0622 

1.4164 

2.1245 

2.8321 

2.8321 

3.1863 

3.1863 

11-20 

3.7609 

3.7609 

3.9019 

3.9019 

4.2560 

4.2560 

4.3971 

5.8124 

6.6966 

7.0506 

21-30 

7.8994 

8.9611 

10.3768 

13.2795 

13.2795 

13.2795 

13.2795 

13.2795 

13.9952 

14.7029 

6 

1-10 

.0000 

.3541 

.3541 

1.0616 

1.4157 

2.4775 

2.6185 

3.3261 

4.0338 

5.2721 

11-20 

5.2721 

5.6262 

6.6879 

6.6879 

7.9262 

8.6337 

8.7748 

9.4825 

9.4825 

9.4825 

21-30 

10.7646 

10.7647 

12.1805 

13.1372 

13.1372 

14.1989 

14.1989 

15.0831 

15.7907 

15.9318 

7 

1-10 

.0000 

1.0616 

1.7692 

3.0076 

3.3617 

4.7775 

5.4850 

5.8391 

6.9009 

6.9009 

11-20 

6.9009 

6.9009 

7.2550 

7. 6090 

7.9631 

8.6707 

9.3783 

9.3783 

10.0865 

10.4406 

21-30 

10.7947 

11.1488 

12.9187 

13.9804 

13.9804 

14.3345 

15.0427 

15.7509 

15.7509 

15.7509 

8 

1-10 

.0000 

.0000 

.0000 

.3541 

1.7699 

3.8933 

5.4850 

5.8391 

6.7960 

7.1500 

11-20 

9.3451 

9.6992 

9.8404 

10.9020 

12.1403 

12.1403 

12.1403 

13.5555 

14.2637 

17.6248 

21-30 

17.6248 

18,6865 

20.4564 

20.8105 

20.8105 

20.8105  22.4029 

23.9953 

24.7029 

25.4105 

100 


TABLE  7— (Continued) 


S  Blocks 


9 

1-10 

.0000 

1.0616 

2.6534 

4.0693 

4.4233 

5.8391 

6.7233 

7.7851 

9.7309 

10.9692 

11-20 

11.3234 

12.0310 

13.2338 

15.6057 

16.8440 

18.4358 

20.4544 

21.8695 

22.2236 

22.5778 

21-30 

22.9318 

24.3470 

25.9394 

28.8421 

29.5497 

31.7448 

32.0989 

34.5755 

35.2831 

35.2831 

10 

1-10 

.0000 

1.0616 

1.0616 

2.8310 

4.0693 

6.1926 

6.3337 

6.3337 

8.3523 

3.3523 

11-20 

8.3523 

9.4139 

11.5010 

11.8550 

11.8550 

12.7393 

14.7577 

16.1729 

16.8811 

17.5887 

21-30 

17.9428 

19.7121 

20.9504 

22.0121 

24.3115 

24.3115 

25.0197 

27.1422 

28.8066 

28.9477 

11 

1-10 

.0000 

I.O616 

1.7692 

2.4769 

4.7768 

5.1310 

6.1563 

6.8639 

7.8207 

9.0590 

11-20 

9.4130 

9.7672 

11.2876 

11.6418 

11.6418 

14.1178 

15.4287 

16.8439 

17.5521 

18.9672 

21-30 

19.5418 

19.5418 

21.3117 

23.0810 

23.0810 

24.1428 

25.7351 

28.2118 

28.3528 

28.3528 

12 

1-10 

.0000 

.0000 

.0000 

.0000 

.0000 

.0000 

.0000 

1.0616  2.1234  2.1234 

11-20 

2.4775 

4.2468 

5.3084 

5.3084 

5.3084 

6.0160 

6.3701 

7.0778 

7.7859 

9.5552 

21-30 

9.9093 

11.6786 

12.7409 

13.0950 

13.0950 

13.0950 

13.4491 

14.1573 

14.1573 

15.5725 

13 

1-10 

.0000 

.3541 

1.9459 

1.9459 

3.0076 

5.1310 

6.1563 

6.1563 

8.1747 

9.1315 

11-20 

11.3266 

11.6807 

12.3171 

12.3171 

12.3171 

12.3171 

14.3355 

15.7508 

15.8919 

18.1912 

21-30 

20.1372 

21.9065 

22.2606 

25.1632 

27.6392 

29.3036 

30.5419 

31.7803 

34.3288 

35.0364 

14 

1-10 

.0000 

.0000 

.1411 

.1411 

1.2028 

2.6185 

5.0945 

6.1563 

6.2974 

6.2974 

11-20 

7.2542 

8.4924 

8.7747 

8.7747 

8.7747 

8.7747 

10.7932 

11.5008 

12.3501 

13.0577 

21-30 

13.1987 

14.9681 

16.7379 

18.6839 

18.6839 

18.6839 

19.3921 

19.7461 

19.8873 

21.3024 

15 

1-10 

.0000 

1.0616 

1.7692 

2.4775 

3.8933 

4.6009 

5.4850 

6.5467 

6.9009 

7.7851 

11-20 

8.1392 

8.4932 

9.5550 

10.6166 

11.5008 

12.2084 

12.5626 

13.9777 

14.6859 

16.2777 

21-30 

16.2777 

17.3394 

18.0476 

19.1093 

19.1093 

19.4634. 

20.7017 

21.0558 

21.0558 

21.9045 

16 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

3.1863 

3.1863 

3.5403 

3.8944 

4.2485 

11-20 

4.6026 

5.6643 

6.0184 

6.3726 

6.7266 

6.7266 

7 .0807 

7.0807 

7.7889 

8.1430 

21-30 

8.4971 

8.8512 

9.9135 

10.2676 

10.2676 

10.6217 

11.3299 

12.0381 

12.0381 

12.0381 
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17 

1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

3.1863 

4.0705 

4.4246 

4.7786 

5.1327 

11-20 

5.4869 

5.8409 

6.1950 

6.5491 

8.8168 

8.8168 

9.1709 

9.1709 

9.8791 

10.2332 

21-30 

10.5873 

10.9414 

12.0037 

12.3578 

12.3578 

12.7119 

13.4201 

13.4201 

13.4201 

13.4201 

18 

1-10 

.0000 

1.9459 

2.8301 

4.4225 

5.1307 

6.9000 

6.9000 

7.2540 

7.6081 

7.9623 

11-20 

10.2622 

10.6164 

10.9704 

10.9704 

10.9704 

11.3245 

12.7398 

13.4479 

14.5096 

21-30 

14.8637 

14.8637 

15.5719 

15.9261 

15.9261 

15.9261 

17.5184 

19.1108 

19.1108 

19.1108 

19 

1-10 

.0000 

.3541 

.3541 

.3541 

.7081 

.7081 

1.4157 

2.1234 

2.6185 

3.8568 

11-20 

4.8136 

5.5212 

6.6877 

7.3953 

7.7493 

9.1646 

9.3057 

10.7209 

11.5702 

11.5702 

21-30 

11.9243 

12.6319 

12.9859 

12.9859 

13.6935 

14.0477 

15.2860 

16.8783 

18.4097 

19.2585 

20 

1-10 

.0000 

.3541 

.3541 

.7081 

1.9910 

2.6991 

2.6991 

3.0532 

3.4074 

3.7615 

11-20 

4.1155 

4.4694 

4.8238 

4.8238 

5.1778 

5.1778 

5.5319 

5.5319 

6.2401 

6.5942 

21-30 

6.9483 

7.3024 

8.3647 

8.7188 

8.7188 

9.0729 

9.7811 

10.4893 

10.4893 

10.4893 

21 

1-10 

.0000 

.0000 

.0000 

.3541 

.7081 

1.0622 

2.6541 

4.0693 

5.1310 

6.3693 

11-20 

6.9439 

7.6514 

8.1467 

9. 2083 

9.5624 

12.0385 

14.0570 

15.4721 

15.9674 

17.0290 

21-30 

18.0908 

20.4346 

22.3805 

23.3373 

24.0449 

24.7525 

25.9909 

26.3449 

27.2291 

28.9265 

22 

1-10 

.0000 

1.0616 

1.7692 

2.4775 

2.8316 

3.8933 

4.7775 

5.8391 

5.8391 

6.7233 

11-20 

7.0774 

8.6693 

9.1645 

10.2262 

11.1104 

12.7022 

13.1973' 

14.6126 

15.8508 

16.2049 

21-30 

16.9126 

17.9743 

18.6825 

20.6283 

21.3359 

23.3545 

24.5928 

26.1851 

26.8928 

27.0339 

23 

1-10 

.8842 

1.5918 

3.0069 

4.0687 

5.3070 

6.7227 

8.4557 

9.4125 

9.7665 

10.6508 

11-20 

11.0049 

13.6583 

14.5425 

14.8967 

16.7376 

18.3295 

19.0370 

20.4522 

21.0268 

22.7961 

21-30 

23.8579 

24.9195 

26.5120 

27.2195 

29.5189 

31.5374 

32.7757 

34.3681 

34.3681 

35.9244 

24 

1-10 

.0000 

1.0616 

2.6534 

4.0693 

4.0693 

5.4850 

6.3337 

7.6446 

7.6446 

8.5288 

11-20 

8.8830 

9.9446 

10.2987 

10.6329 

11.5371 

12.2447 

13.3063 

14.0140 

14.3681 

16.1373 

21-30 

16.1373 

17.1990 

18.2613 

18.9689 

18.9689 

20.0306 

20.3847 

21.9771 

21.9771 

22.8258 

102 
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1-10 

.0000 

.35^1 

.3541 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

11-20 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

21-30 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

.7081 

TABLE  8 

INDIVIDUAL  CUMULATIVE  REGRET  FUNCTIONS  pOR  BLOCKS  OP  FIVE  TRIALS 
FOR  SUBJECTS  WHO  MADE  ALL  RESPONSES  ACCORDING  to  THF  RESPONSE  INDICATED 
BY  THE  CONDITIONAL  PROBABILITIES  ON  THE  FIGURE  PRESENTED  IN  THE  EXPERIMENT* 

OROUp  CP-CC  (N  =  10) 

GROUP  CP-CC  (N  =  33) 


Blocks 


•  1-10 

.0000 

.3541 

.3541 

1.0622 

1.7705 

2.4786 

2.4786 

2.8328 

3.1869 

3.5409 

11-20 

3.8950 

4.2491 

4.6032 

4.9573 

5.3114 

5.3114 

5.6655 

5.6655 

6.3737 

6.7278 

21-30 

7.0819 

7.4360 

8.4983 

8.8524 

8.8524 

9.2065 

9.9147 

10.6229 

10.6229 

10.6229 

*NOTE:  Since  the  cumulative  regret  function  is  the  same  for  each  subject,  the  function 

is  presented  only  once. 
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